Apr 28 05:42:51 devstack cinder-volume[72296]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 28 05:42:51 devstack cinder-volume[72296]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 28 05:42:51 devstack cinder-volume[72296]: we strongly recommend against using it for new projects. Apr 28 05:42:51 devstack cinder-volume[72296]: If you are already using Eventlet, we recommend migrating to a different Apr 28 05:42:51 devstack cinder-volume[72296]: framework. For more detail see Apr 28 05:42:51 devstack cinder-volume[72296]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 28 05:42:51 devstack cinder-volume[72296]: import eventlet # noqa Apr 28 05:42:53 devstack cinder-volume[72296]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72296) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 05:42:53 devstack cinder-volume[72296]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72296) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 05:42:53 devstack cinder-volume[72296]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72296) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 05:42:54 devstack cinder-volume[72296]: INFO dbcounter [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Registered counter for database cinder Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_db.sqlalchemy.engines [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72296) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG dbcounter [-] [72296] Writer thread running {{(pid=72296) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 28 05:42:54 devstack cinder-volume[72296]: INFO cinder.rpc [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 28 05:42:54 devstack cinder-volume[72296]: INFO cinder.rpc [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_db.sqlalchemy.engines [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72296) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 05:42:54 devstack cinder-volume[72296]: INFO cinder.volume.manager [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Determined volume DB was empty at startup. Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG cinder.volume.manager [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72296) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 28 05:42:54 devstack cinder-volume[72296]: INFO cinder.volume.manager [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 28 05:42:54 devstack cinder-volume[72296]: WARNING stevedore.named [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 28 05:42:54 devstack cinder-volume[72296]: WARNING castellan.key_manager [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 05:42:54 devstack cinder-volume[72296]: WARNING cinder.keymgr.conf_key_mgr [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG cinder.volume.drivers.lvm [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72296) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_concurrency.processutils [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72296) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_concurrency.processutils [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] CMD "cinder-rtstool verify" returned: 0 in 0.254s {{(pid=72296) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_db.sqlalchemy.engines [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72296) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 05:42:54 devstack cinder-volume[72296]: INFO cinder.rpc [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 28 05:42:54 devstack cinder-volume[72296]: INFO cinder.rpc [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 28 05:42:54 devstack cinder-volume[72296]: WARNING stevedore.named [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 28 05:42:54 devstack cinder-volume[72296]: WARNING castellan.key_manager [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 05:42:54 devstack cinder-volume[72296]: INFO cinder.volume.manager [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_db.sqlalchemy.engines [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72296) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 05:42:54 devstack cinder-volume[72296]: INFO oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Starting 1 workers Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Started child 72407 {{(pid=72296) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Full set of CONF: {{(pid=72296) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] ******************************************************************************** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Configuration options gathered from: {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 28 05:42:54 devstack cinder-volume[72407]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] ================================================================================ {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] allow_availability_zone_fallback = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] allow_compression_on_image_upload = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] allowed_direct_url_schemes = [] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] api_rate_limit = True {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] auth_strategy = keystone {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] az_cache_duration = 3600 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_availability_zone = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_host = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_name = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_stats_polling_interval = 60 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backup_api_class = cinder.backup.api.API {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backup_name_template = backup-%s {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backup_use_same_host = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backup_use_temp_snapshot = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] chap_password = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] chap_username = {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cinder_internal_tenant_project_id = a56fd1234285459d9245db6ac002ccd8 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cinder_internal_tenant_user_id = 84d2f9c7be9f484694586e5815ede83b {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cloned_volume_same_az = True {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cluster = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] compression_format = gzip {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] compute_api_class = cinder.compute.nova.API {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] config_dir = [] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] config_source = [] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72407]: INFO cinder.volume.manager [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] control_exchange = openstack {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] debug = True {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] default_availability_zone = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] default_group_type = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] default_volume_type = lvmdriver-1 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] disk_geometry = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] driver_client_cert = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] driver_client_cert_key = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] driver_data_namespace = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] driver_ssl_cert_path = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] driver_ssl_cert_verify = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] driver_use_ssl = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] enable_force_upload = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] enable_new_services = True {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] enable_unsupported_driver = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] enforce_multipath_for_image_xfer = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] filter_function = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] glance_api_insecure = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] glance_api_servers = ['http://192.168.122.99/image'] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] glance_api_ssl_compression = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] glance_ca_certificates_file = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] glance_catalog_info = image:glance:publicURL {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] glance_certfile = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] glance_keyfile = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] glance_num_retries = 3 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] glance_request_timeout = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] goodness_function = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] graceful_shutdown_timeout = 5 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] group_api_class = cinder.group.api.API {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] host = devstack {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] image_compress_on_upload = True {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] image_conversion_address_space_limit = 1 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] image_conversion_cpu_limit = 60 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] image_conversion_disable = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] image_upload_use_cinder_backend = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] image_upload_use_internal_tenant = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] image_volume_cache_enabled = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] image_volume_cache_max_count = 0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] image_volume_cache_max_size_gb = 0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] init_host_max_objects_retrieval = 0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] instance_format = [instance: %(uuid)s] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] iscsi_target_flags = {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] iscsi_write_cache = on {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] iser_helper = tgtadm {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] iser_ip_address = 192.168.122.99 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] iser_port = 3260 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] log_color = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] log_config_append = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] log_dir = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] log_file = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] log_options = True {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] log_rotate_interval = 1 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] log_rotate_interval_type = days {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] log_rotation_type = none {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] max_age = 0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] max_logfile_count = 30 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] max_logfile_size_mb = 200 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] max_over_subscription_ratio = 20.0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] message_reap_interval = 86400 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] message_ttl = 2592000 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] migration_create_volume_timeout_secs = 300 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] monkey_patch = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] monkey_patch_modules = [] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] my_ip = 192.168.122.99 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] no_snapshot_gb_quota = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] num_iser_scan_tries = 3 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] num_shell_tries = 3 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] num_volume_device_scan_tries = 3 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] nvmeof_conn_info_version = 1 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] nvmet_ns_id = 10 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] nvmet_port_id = 1 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] osapi_max_limit = 1000 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] osapi_volume_ext_list = [] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] osapi_volume_listen_port = 8776 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] osapi_volume_use_ssl = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] osapi_volume_workers = 2 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] per_volume_size_limit = -1 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] periodic_fuzzy_delay = 60 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] periodic_interval = 60 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] public_endpoint = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] publish_errors = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] quota_backup_gigabytes = 1000 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] quota_backups = 10 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] quota_gigabytes = 1000 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] quota_groups = 10 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] quota_snapshots = 10 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] quota_volumes = 10 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] rate_limit_burst = 0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] rate_limit_except_level = CRITICAL {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] rate_limit_interval = 0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] reinit_driver_count = 3 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] replication_device = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] report_discard_supported = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] report_interval = 120 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] reservation_clean_interval = 86400 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] reservation_expire = 86400 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] reserved_image_namespaces = [] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] reserved_percentage = 0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] rpc_response_timeout = 120 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] run_external_periodic_tasks = True {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] scst_target_driver = iscsi {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] scst_target_iqn_name = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] service_down_time = 720 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] shell_completion = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] snapshot_name_template = snapshot-%s {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] snapshot_same_host = True {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] split_loggers = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] state_path = /opt/stack/data/cinder {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] storage_availability_zone = nova {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] storage_protocol = iSCSI {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] syslog_log_facility = LOG_USER {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] target_helper = lioadm {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] target_ip_address = 192.168.122.99 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] target_port = 3260 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] target_protocol = iscsi {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] target_secondary_ip_addresses = [] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] trace_flags = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] transport_url = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] until_refresh = 0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] use_chap_auth = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] use_default_quota_class = True {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] use_journal = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] use_json = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] use_multipath_for_image_xfer = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] use_stderr = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] use_syslog = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] verify_glance_signatures = enabled {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] volume_api_class = cinder.volume.api.API {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] volume_backend_name = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] volume_clear = zero {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] volume_clear_ionice = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] volume_clear_size = 0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] volume_copy_bps_limit = 0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] volume_dd_blocksize = 1M {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] volume_name_template = volume-%s {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] volume_service_inithost_offload = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] volume_usage_audit_period = month {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] zoning_mode = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_concurrency.disable_process_locking = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.admin_password = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.admin_token = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.admin_user = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.auth_port = 35357 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.auth_protocol = https {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.auth_section = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.auth_type = password {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.auth_uri = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.auth_version = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.cache = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.certfile = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.identity_uri = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.include_service_catalog = True {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.insecure = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.interface = public {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.keyfile = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.memcache_password = {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.memcache_username = {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.region_name = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.service_type = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.99/identity {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.backend = dogpile.cache.null {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.backend_argument = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.backend_expiration_time = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.config_prefix = cache.oslo {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.debug_cache_backend = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.enable_retry_client = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.enable_socket_keepalive = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.enabled = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.enforce_fips_mode = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.expiration_time = 600 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.hashclient_retry_attempts = 2 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.memcache_dead_retry = 300 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.memcache_pool_maxsize = 10 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.memcache_sasl_enabled = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.password = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.proxies = [] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.redis_db = 0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.redis_server = localhost:6379 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.retry_attempts = 2 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.retry_delay = 0.0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.socket_keepalive_count = 1 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.socket_keepalive_idle = 1 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.socket_keepalive_interval = 1 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.socket_timeout = 1.0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.tls_allowed_ciphers = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.tls_cafile = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.tls_certfile = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.tls_enabled = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.tls_keyfile = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cache.username = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] coordination.backend_url = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.asyncio_connection = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.asyncio_slave_connection = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.backend = sqlalchemy {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.connection = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.connection_debug = 0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.connection_parameters = {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.connection_recycle_time = 3600 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.connection_trace = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.db_inc_retry_interval = True {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.db_max_retries = 20 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.db_max_retry_interval = 10 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.db_retry_interval = 1 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.max_overflow = 50 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.max_pool_size = 5 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.max_retries = 10 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.mysql_wsrep_sync_wait = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.pool_timeout = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.retry_interval = 10 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.slave_connection = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.sqlite_synchronous = True {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.synchronous_reader = True {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] database.use_db_reconnect = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] profiler.connection_string = messaging:// {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] profiler.enabled = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] profiler.es_doc_type = notification {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] profiler.es_scroll_size = 10000 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] profiler.es_scroll_time = 2m {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] profiler.filter_error_trace = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] profiler.hmac_keys = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] profiler.sentinel_service_name = mymaster {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] profiler.socket_timeout = 0.1 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] profiler.trace_requests = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] profiler.trace_sqlalchemy = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] profiler_jaeger.process_tags = {} {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] profiler_jaeger.service_name_prefix = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] profiler_otlp.service_name_prefix = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_policy.enforce_new_defaults = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: WARNING oslo_config.cfg [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_policy.enforce_scope = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_policy.policy_default_rule = default {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_policy.policy_file = policy.yaml {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] privsep_osbrick.group = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] privsep_osbrick.helper_command = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] privsep_osbrick.user = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack sudo[72417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cinder_sys_admin.group = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cinder_sys_admin.helper_command = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack sudo[72417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] cinder_sys_admin.user = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] service_user.auth_section = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] service_user.auth_type = password {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] service_user.cafile = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] service_user.certfile = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] service_user.collect_timing = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] service_user.insecure = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] service_user.keyfile = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] service_user.send_service_user_token = True {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] service_user.split_loggers = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] service_user.timeout = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] glance.auth_section = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] glance.auth_type = password {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] glance.certfile = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] glance.collect_timing = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] glance.insecure = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] glance.keyfile = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] glance.region_name = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] glance.split_loggers = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] glance.timeout = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.backend_availability_zone = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.chap_password = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.chap_username = {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.disk_geometry = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.driver_client_cert = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.driver_client_cert_key = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.driver_data_namespace = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.driver_use_ssl = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.extra_capabilities = {} {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.filter_function = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.goodness_function = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.iscsi_target_flags = {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.iscsi_write_cache = on {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.iser_helper = tgtadm {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.iser_ip_address = 192.168.122.99 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.iser_port = 3260 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.lvm_share_target = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.lvm_type = auto {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.num_shell_tries = 3 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.replication_device = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.report_discard_supported = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.reserved_percentage = 0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.target_helper = tgtadm {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.target_ip_address = 192.168.122.99 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.target_port = 3260 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.target_protocol = iscsi {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.trace_flags = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.unique_fqdn_network = True {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.use_chap_auth = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.volume_backend_name = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.volume_clear = zero {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.volume_clear_ionice = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.volume_clear_size = 0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_reports.file_event_handler = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_reports.log_dir = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.backend_host = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.chap_password = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.chap_username = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.disk_geometry = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.driver_client_cert = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.extra_capabilities = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.filter_function = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.goodness_function = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.iser_helper = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.iser_ip_address = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.iser_port = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:54 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.lvm_share_target = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.lvm_type = auto {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.num_shell_tries = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.replication_device = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.report_discard_supported = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.reserved_percentage = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.scst_target_driver = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.storage_protocol = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.target_helper = lioadm {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.target_ip_address = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.target_port = 3260 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.trace_flags = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.use_chap_auth = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.volume_clear = zero {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.volume_clear_size = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] lvmdriver-1.volumes_dir = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.ssl = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_notifications.driver = [] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_notifications.retry = -1 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] key_manager.fixed_key = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican.barbican_api_version = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican.barbican_endpoint = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican.barbican_endpoint_type = public {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican.barbican_region_name = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican.cafile = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican.certfile = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican.collect_timing = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican.insecure = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican.keyfile = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican.number_of_retries = 60 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican.retry_delay = 1 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican.send_service_user_token = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican.split_loggers = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican.timeout = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican.verify_ssl = True {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican.verify_ssl_path = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican_service_user.auth_section = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican_service_user.auth_type = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican_service_user.cafile = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican_service_user.certfile = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican_service_user.collect_timing = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican_service_user.insecure = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican_service_user.keyfile = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican_service_user.split_loggers = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] barbican_service_user.timeout = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] vault.approle_role_id = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] vault.approle_secret_id = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] vault.kv_mountpoint = secret {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] vault.kv_path = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] vault.kv_version = 2 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] vault.namespace = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] vault.root_token_id = **** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] vault.ssl_ca_crt_file = None {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] vault.timeout = 60.0 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] vault.use_ssl = False {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:42:55 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] ******************************************************************************** {{(pid=72296) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 28 05:42:55 devstack sudo[72417]: pam_unix(sudo:session): session closed for user root Apr 28 05:42:55 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:42:55 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:42:55 devstack sudo[72593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 05:42:55 devstack sudo[72593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:42:56 devstack sudo[72593]: pam_unix(sudo:session): session closed for user root Apr 28 05:42:56 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.549s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:42:56 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 05:42:56 devstack cinder-volume[72407]: INFO cinder.brick.local_dev.lvm [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 28 05:42:56 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:42:56 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:42:56 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:42:56 devstack sudo[72804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 05:42:56 devstack sudo[72804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:42:56 devstack sudo[72804]: pam_unix(sudo:session): session closed for user root Apr 28 05:42:56 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:42:56 devstack cinder-volume[72407]: DEBUG cinder.brick.local_dev.lvm [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72407) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 28 05:42:56 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:42:56 devstack sudo[72930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 05:42:56 devstack sudo[72930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:42:57 devstack sudo[72930]: pam_unix(sudo:session): session closed for user root Apr 28 05:42:57 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.918s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:42:57 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:42:57 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:42:57 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:42:57 devstack sudo[73099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 05:42:57 devstack sudo[73099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:42:58 devstack sudo[73099]: pam_unix(sudo:session): session closed for user root Apr 28 05:42:58 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.480s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:42:58 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:42:58 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:42:58 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:42:58 devstack sudo[73103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 28 05:42:58 devstack sudo[73103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:42:58 devstack sudo[73103]: pam_unix(sudo:session): session closed for user root Apr 28 05:42:58 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.480s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:42:58 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:42:58 devstack sudo[73106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 05:42:58 devstack sudo[73106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:42:59 devstack sudo[73106]: pam_unix(sudo:session): session closed for user root Apr 28 05:42:59 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.519s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:42:59 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:42:59 devstack sudo[73111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 05:42:59 devstack sudo[73111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:42:59 devstack sudo[73111]: pam_unix(sudo:session): session closed for user root Apr 28 05:42:59 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:42:59 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:42:59 devstack sudo[73117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 05:42:59 devstack sudo[73117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:43:00 devstack sudo[73117]: pam_unix(sudo:session): session closed for user root Apr 28 05:43:00 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.467s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:43:00 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:43:00 devstack sudo[73122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 05:43:00 devstack sudo[73122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:43:00 devstack sudo[73122]: pam_unix(sudo:session): session closed for user root Apr 28 05:43:00 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.489s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:43:00 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:43:00 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:43:00 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:43:00 devstack sudo[73127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 05:43:00 devstack sudo[73127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:43:01 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.676s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:43:01 devstack cinder-volume[72407]: INFO cinder.volume.drivers.lvm [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 28 05:43:01 devstack sudo[73127]: pam_unix(sudo:session): session closed for user root Apr 28 05:43:01 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:43:01 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:43:01 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:43:01 devstack sudo[73234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 05:43:01 devstack sudo[73234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:43:01 devstack sudo[73234]: pam_unix(sudo:session): session closed for user root Apr 28 05:43:01 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.455s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:43:01 devstack cinder-volume[72407]: DEBUG cinder.volume.drivers.lvm [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Updating volume stats {{(pid=72407) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 05:43:01 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:43:01 devstack sudo[73251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 05:43:01 devstack sudo[73251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:43:02 devstack sudo[73251]: pam_unix(sudo:session): session closed for user root Apr 28 05:43:02 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.483s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:43:02 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:43:02 devstack sudo[73313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 05:43:02 devstack sudo[73313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:43:02 devstack sudo[73313]: pam_unix(sudo:session): session closed for user root Apr 28 05:43:02 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:43:02 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:43:02 devstack sudo[73396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 05:43:02 devstack sudo[73396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:43:03 devstack sudo[73396]: pam_unix(sudo:session): session closed for user root Apr 28 05:43:03 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.515s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:43:03 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:43:03 devstack sudo[73402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 05:43:03 devstack sudo[73402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:43:03 devstack sudo[73402]: pam_unix(sudo:session): session closed for user root Apr 28 05:43:03 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:43:03 devstack cinder-volume[72407]: INFO cinder.volume.driver [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Driver hasn't implemented _init_vendor_properties() Apr 28 05:43:03 devstack cinder-volume[72407]: DEBUG cinder.volume.driver [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72407) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 28 05:43:03 devstack cinder-volume[72407]: DEBUG oslo_db.sqlalchemy.engines [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72407) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 05:43:03 devstack cinder-volume[72407]: DEBUG dbcounter [-] [72407] Writer thread running {{(pid=72407) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 28 05:43:03 devstack cinder-volume[72407]: DEBUG cinder.db.sqlalchemy.api [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Building query based on filter {{(pid=72407) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 28 05:43:03 devstack cinder-volume[72407]: DEBUG cinder.image.image_utils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72407) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 28 05:43:03 devstack cinder-volume[72407]: INFO cinder.keymgr.migration [None req-5e16043c-345a-4eb0-8204-2878d85448d1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 28 05:43:03 devstack cinder-volume[72407]: DEBUG cinder.volume.drivers.lvm [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Updating volume stats {{(pid=72407) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 05:43:03 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:43:03 devstack sudo[73406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 05:43:03 devstack sudo[73406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:43:04 devstack sudo[73406]: pam_unix(sudo:session): session closed for user root Apr 28 05:43:04 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.497s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:43:04 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:43:04 devstack sudo[73410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 05:43:04 devstack sudo[73410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:43:04 devstack cinder-volume[72296]: DEBUG dbcounter [-] [72296] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72296) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:43:04 devstack sudo[73410]: pam_unix(sudo:session): session closed for user root Apr 28 05:43:04 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:43:04 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:43:04 devstack sudo[73414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 05:43:04 devstack sudo[73414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:43:05 devstack sudo[73414]: pam_unix(sudo:session): session closed for user root Apr 28 05:43:05 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.612s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:43:05 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:43:05 devstack sudo[73422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 05:43:05 devstack sudo[73422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:43:05 devstack sudo[73422]: pam_unix(sudo:session): session closed for user root Apr 28 05:43:05 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.528s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:43:05 devstack cinder-volume[72407]: DEBUG cinder.manager [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Notifying Schedulers of capabilities ... {{(pid=72407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:43:05 devstack cinder-volume[72407]: INFO cinder.volume.manager [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Driver initialization completed successfully. Apr 28 05:43:05 devstack cinder-volume[72407]: INFO cinder.manager [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Initiating service 2 cleanup Apr 28 05:43:05 devstack cinder-volume[72407]: INFO cinder.manager [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Service 2 cleanup completed. Apr 28 05:43:05 devstack cinder-volume[72407]: DEBUG cinder.service [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Creating RPC server for service cinder-volume {{(pid=72407) start /opt/stack/cinder/cinder/service.py:231}} Apr 28 05:43:06 devstack cinder-volume[72407]: DEBUG cinder.service [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72407) start /opt/stack/cinder/cinder/service.py:237}} Apr 28 05:43:06 devstack cinder-volume[72407]: INFO cinder.volume.manager [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 28 05:43:06 devstack cinder-volume[72407]: DEBUG cinder.volume.drivers.lvm [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Updating volume stats {{(pid=72407) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 05:43:06 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:43:06 devstack sudo[73425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 05:43:06 devstack sudo[73425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:43:06 devstack sudo[73425]: pam_unix(sudo:session): session closed for user root Apr 28 05:43:06 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.564s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:43:06 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:43:06 devstack sudo[73430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 05:43:06 devstack sudo[73430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:43:07 devstack sudo[73430]: pam_unix(sudo:session): session closed for user root Apr 28 05:43:07 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.577s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:43:07 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:43:07 devstack sudo[73433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 05:43:07 devstack sudo[73433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:43:07 devstack sudo[73433]: pam_unix(sudo:session): session closed for user root Apr 28 05:43:07 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.459s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:43:07 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:43:07 devstack sudo[73597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 05:43:07 devstack sudo[73597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:43:08 devstack sudo[73597]: pam_unix(sudo:session): session closed for user root Apr 28 05:43:08 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:43:08 devstack cinder-volume[72407]: INFO cinder.volume.manager [None req-601a8b4c-5713-4eae-a139-c372bfa80aec None None] Driver post RPC initialization completed successfully. Apr 28 05:43:18 devstack cinder-volume[72407]: DEBUG dbcounter [-] [72407] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72407) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:43:18 devstack cinder-volume[72407]: DEBUG dbcounter [-] [72407] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=72407) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:44:00 devstack cinder-volume[72407]: DEBUG oslo_service.periodic_task [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72407) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 05:44:00 devstack cinder-volume[72407]: DEBUG cinder.volume.drivers.lvm [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] Updating volume stats {{(pid=72407) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 05:44:00 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:44:00 devstack sudo[75749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 05:44:00 devstack sudo[75749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:44:00 devstack sudo[75749]: pam_unix(sudo:session): session closed for user root Apr 28 05:44:00 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.579s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:44:00 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:44:00 devstack sudo[75755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 05:44:00 devstack sudo[75755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:44:01 devstack sudo[75755]: pam_unix(sudo:session): session closed for user root Apr 28 05:44:01 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:44:01 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:44:01 devstack sudo[75761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 05:44:01 devstack sudo[75761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:44:01 devstack sudo[75761]: pam_unix(sudo:session): session closed for user root Apr 28 05:44:01 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.437s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:44:01 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:44:01 devstack sudo[75764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 05:44:01 devstack sudo[75764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:44:02 devstack sudo[75764]: pam_unix(sudo:session): session closed for user root Apr 28 05:44:02 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:44:02 devstack cinder-volume[72407]: DEBUG cinder.manager [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] Notifying Schedulers of capabilities ... {{(pid=72407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:45:00 devstack cinder-volume[72407]: DEBUG oslo_service.periodic_task [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72407) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 05:45:00 devstack cinder-volume[72407]: DEBUG cinder.volume.drivers.lvm [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] Updating volume stats {{(pid=72407) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 05:45:00 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:45:00 devstack sudo[78547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 05:45:00 devstack sudo[78547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:45:00 devstack sudo[78547]: pam_unix(sudo:session): session closed for user root Apr 28 05:45:00 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:45:00 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:45:00 devstack sudo[78551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 05:45:00 devstack sudo[78551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:45:01 devstack sudo[78551]: pam_unix(sudo:session): session closed for user root Apr 28 05:45:01 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:45:01 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:45:01 devstack sudo[78556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 05:45:01 devstack sudo[78556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:45:01 devstack sudo[78556]: pam_unix(sudo:session): session closed for user root Apr 28 05:45:01 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.439s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:45:01 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:45:01 devstack sudo[78568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 05:45:01 devstack sudo[78568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:45:01 devstack sudo[78568]: pam_unix(sudo:session): session closed for user root Apr 28 05:45:01 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:45:01 devstack cinder-volume[72407]: DEBUG cinder.manager [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] Notifying Schedulers of capabilities ... {{(pid=72407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:45:18 devstack cinder-volume[72407]: DEBUG dbcounter [-] [72407] Writing DB stats cinder:SELECT=1 {{(pid=72407) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:45:18 devstack cinder-volume[72407]: DEBUG dbcounter [-] [72407] Writing DB stats cinder:UPDATE=1 {{(pid=72407) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:46:00 devstack cinder-volume[72407]: DEBUG oslo_service.periodic_task [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72407) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 05:46:00 devstack cinder-volume[72407]: DEBUG cinder.volume.drivers.lvm [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] Updating volume stats {{(pid=72407) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 28 05:46:00 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:46:00 devstack sudo[80617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 28 05:46:00 devstack sudo[80617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:46:00 devstack sudo[80617]: pam_unix(sudo:session): session closed for user root Apr 28 05:46:00 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:46:00 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:46:00 devstack sudo[80622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 05:46:00 devstack sudo[80622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:46:01 devstack sudo[80622]: pam_unix(sudo:session): session closed for user root Apr 28 05:46:01 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:46:01 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:46:01 devstack sudo[80643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 28 05:46:01 devstack sudo[80643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:46:01 devstack sudo[80643]: pam_unix(sudo:session): session closed for user root Apr 28 05:46:01 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.434s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:46:01 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:46:01 devstack sudo[80654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 28 05:46:01 devstack sudo[80654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:46:01 devstack sudo[80654]: pam_unix(sudo:session): session closed for user root Apr 28 05:46:01 devstack cinder-volume[72407]: DEBUG oslo_concurrency.processutils [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=72407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:46:01 devstack cinder-volume[72407]: DEBUG cinder.manager [None req-d42ab2e0-94fd-4f87-a850-183d9228150b None None] Notifying Schedulers of capabilities ... {{(pid=72407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:46:34 devstack cinder-volume[72296]: INFO oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Caught SIGTERM, stopping children Apr 28 05:46:34 devstack cinder-volume[72296]: DEBUG oslo_concurrency.lockutils [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Acquiring lock "singleton_lock" {{(pid=72296) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 05:46:34 devstack cinder-volume[72296]: DEBUG oslo_concurrency.lockutils [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Acquired lock "singleton_lock" {{(pid=72296) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 05:46:34 devstack cinder-volume[72296]: DEBUG oslo_concurrency.lockutils [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Releasing lock "singleton_lock" {{(pid=72296) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 05:46:34 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Stop services. {{(pid=72296) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 28 05:46:34 devstack cinder-volume[72296]: DEBUG oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Killing children. {{(pid=72296) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 28 05:46:34 devstack cinder-volume[72296]: INFO oslo_service.backend._eventlet.service [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Waiting on 1 children to exit Apr 28 05:46:39 devstack cinder-volume[72407]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 28 05:46:39 devstack cinder-volume[81372]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 28 05:46:39 devstack cinder-volume[81372]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 28 05:46:39 devstack cinder-volume[81372]: we strongly recommend against using it for new projects. Apr 28 05:46:39 devstack cinder-volume[81372]: If you are already using Eventlet, we recommend migrating to a different Apr 28 05:46:39 devstack cinder-volume[81372]: framework. For more detail see Apr 28 05:46:39 devstack cinder-volume[81372]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 28 05:46:39 devstack cinder-volume[81372]: import eventlet # noqa Apr 28 05:46:41 devstack cinder-volume[72407]: DEBUG oslo_concurrency.lockutils [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Acquiring lock "singleton_lock" {{(pid=72407) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 05:46:41 devstack cinder-volume[72407]: DEBUG oslo_concurrency.lockutils [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Acquired lock "singleton_lock" {{(pid=72407) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 05:46:41 devstack cinder-volume[72407]: DEBUG oslo_concurrency.lockutils [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Releasing lock "singleton_lock" {{(pid=72407) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 05:46:41 devstack cinder-volume[72407]: WARNING amqp [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 28 05:46:41 devstack cinder-volume[72407]: WARNING amqp [None req-904b1050-e717-4f34-bd99-b08a923b9ce7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 28 05:46:41 devstack cinder-volume[81372]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81372) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 05:46:41 devstack cinder-volume[81372]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81372) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 05:46:41 devstack cinder-volume[81372]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81372) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 05:46:42 devstack cinder-volume[81372]: INFO dbcounter [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Registered counter for database cinder Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_db.sqlalchemy.engines [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81372) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG dbcounter [-] [81372] Writer thread running {{(pid=81372) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 28 05:46:42 devstack cinder-volume[81372]: INFO cinder.rpc [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 28 05:46:42 devstack cinder-volume[81372]: INFO cinder.rpc [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_db.sqlalchemy.engines [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81372) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 05:46:42 devstack cinder-volume[81372]: INFO cinder.volume.manager [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Determined volume DB was empty at startup. Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG cinder.volume.manager [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81372) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 28 05:46:42 devstack cinder-volume[81372]: INFO cinder.volume.manager [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 28 05:46:42 devstack cinder-volume[81372]: WARNING stevedore.named [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 28 05:46:42 devstack cinder-volume[81372]: WARNING castellan.key_manager [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 05:46:42 devstack cinder-volume[81372]: WARNING cinder.keymgr.conf_key_mgr [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 05:46:42 devstack cinder-volume[81372]: INFO cinder.volume.manager [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_db.sqlalchemy.engines [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81372) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 05:46:42 devstack cinder-volume[81372]: INFO oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Starting 1 workers Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Started child 81491 {{(pid=81372) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Full set of CONF: {{(pid=81372) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] ******************************************************************************** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Configuration options gathered from: {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 28 05:46:42 devstack cinder-volume[81491]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] ================================================================================ {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] allow_availability_zone_fallback = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] allow_compression_on_image_upload = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] allowed_direct_url_schemes = [] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] api_rate_limit = True {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] auth_strategy = keystone {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_availability_zone = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_host = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_name = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_stats_polling_interval = 60 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backup_api_class = cinder.backup.api.API {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backup_name_template = backup-%s {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backup_use_same_host = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backup_use_temp_snapshot = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] chap_password = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] chap_username = {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cinder_internal_tenant_project_id = a56fd1234285459d9245db6ac002ccd8 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cinder_internal_tenant_user_id = 84d2f9c7be9f484694586e5815ede83b {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cluster = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] compression_format = gzip {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] compute_api_class = cinder.compute.nova.API {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] config_dir = [] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] config_source = [] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] control_exchange = openstack {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] debug = True {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] default_availability_zone = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] default_group_type = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81491]: INFO cinder.volume.manager [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Starting volume driver QuobyteDriver (1.1.14) Apr 28 05:46:42 devstack cinder-volume[81491]: DEBUG cinder.volume.drivers.remotefs [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81491) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] default_volume_type = QuobyteHD {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] disk_geometry = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] driver_client_cert = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] driver_client_cert_key = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] driver_data_namespace = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] driver_ssl_cert_path = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] driver_ssl_cert_verify = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] driver_use_ssl = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] enable_new_services = True {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] enable_unsupported_driver = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] enabled_backends = ['QuobyteHD'] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] enforce_multipath_for_image_xfer = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] filter_function = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] glance_api_insecure = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] glance_api_servers = ['http://192.168.122.99/image'] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] glance_api_ssl_compression = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] glance_ca_certificates_file = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] glance_catalog_info = image:glance:publicURL {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] glance_certfile = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] glance_keyfile = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] glance_num_retries = 3 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] glance_request_timeout = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] goodness_function = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] graceful_shutdown_timeout = 5 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] group_api_class = cinder.group.api.API {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] host = devstack {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] image_compress_on_upload = True {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] image_conversion_address_space_limit = 1 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] image_conversion_cpu_limit = 60 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] image_conversion_disable = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] image_upload_use_cinder_backend = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] image_upload_use_internal_tenant = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] image_volume_cache_enabled = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] image_volume_cache_max_count = 0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] image_volume_cache_max_size_gb = 0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] init_host_max_objects_retrieval = 0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] instance_format = [instance: %(uuid)s] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] iscsi_target_flags = {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] iscsi_write_cache = on {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] iser_helper = tgtadm {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] iser_ip_address = 192.168.122.99 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] iser_port = 3260 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] log_color = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] log_config_append = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] log_dir = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] log_file = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] log_options = True {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] log_rotate_interval = 1 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] log_rotate_interval_type = days {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] log_rotation_type = none {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] max_age = 0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] max_logfile_count = 30 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] max_logfile_size_mb = 200 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] max_over_subscription_ratio = 20.0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] message_reap_interval = 86400 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] message_ttl = 2592000 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] migration_create_volume_timeout_secs = 300 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] monkey_patch = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] monkey_patch_modules = [] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] my_ip = 192.168.122.99 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] no_snapshot_gb_quota = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] num_iser_scan_tries = 3 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] num_shell_tries = 3 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81491]: DEBUG cinder.volume.drivers.quobyte [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81491) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 28 05:46:42 devstack cinder-volume[81491]: WARNING cinder.volume.drivers.quobyte [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 28 05:46:42 devstack cinder-volume[81491]: WARNING cinder.volume.drivers.quobyte [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 28 05:46:42 devstack cinder-volume[81491]: DEBUG oslo_concurrency.processutils [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Running cmd (subprocess): mount.quobyte {{(pid=81491) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] num_volume_device_scan_tries = 3 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] nvmeof_conn_info_version = 1 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] nvmet_ns_id = 10 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] nvmet_port_id = 1 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] osapi_max_limit = 1000 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] osapi_volume_ext_list = [] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] osapi_volume_listen = 0.0.0.0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] osapi_volume_listen_port = 8776 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] osapi_volume_use_ssl = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] osapi_volume_workers = 2 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] per_volume_size_limit = -1 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] periodic_fuzzy_delay = 60 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] periodic_interval = 60 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] project_id_regex = [0-9a-f\-]+ {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] public_endpoint = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] publish_errors = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] quota_backup_gigabytes = 1000 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] quota_backups = 10 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] quota_gigabytes = 1000 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] quota_groups = 10 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] quota_snapshots = 10 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] quota_volumes = 10 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] rate_limit_burst = 0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] rate_limit_except_level = CRITICAL {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] rate_limit_interval = 0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] reinit_driver_count = 3 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] replication_device = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] report_discard_supported = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] report_interval = 120 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] reservation_clean_interval = 86400 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] reservation_expire = 86400 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] reserved_image_namespaces = [] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] reserved_percentage = 0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] rpc_response_timeout = 120 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] run_external_periodic_tasks = True {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] scst_target_driver = iscsi {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] scst_target_iqn_name = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] service_down_time = 720 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] shell_completion = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] snapshot_name_template = snapshot-%s {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] split_loggers = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] state_path = /opt/stack/data/cinder {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] storage_availability_zone = nova {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] storage_protocol = iSCSI {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] syslog_log_facility = LOG_USER {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] target_helper = lioadm {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] target_ip_address = 192.168.122.99 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] target_port = 3260 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] target_protocol = iscsi {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] target_secondary_ip_addresses = [] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] trace_flags = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] transfer_api_class = cinder.transfer.api.API {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] transport_url = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] until_refresh = 0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] use_chap_auth = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] use_default_quota_class = True {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] use_journal = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] use_json = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] use_multipath_for_image_xfer = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] use_stderr = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] use_syslog = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] verify_glance_signatures = enabled {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] volume_api_class = cinder.volume.api.API {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] volume_backend_name = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] volume_clear = zero {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] volume_clear_ionice = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] volume_clear_size = 0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] volume_copy_bps_limit = 0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] volume_dd_blocksize = 1M {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] volume_name_template = volume-%s {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] volume_service_inithost_offload = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] volume_usage_audit_period = month {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] zoning_mode = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_concurrency.disable_process_locking = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.admin_password = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.admin_token = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.admin_user = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.auth_admin_prefix = {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.auth_port = 35357 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.auth_protocol = https {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.auth_section = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.auth_type = password {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.auth_uri = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.auth_version = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.cache = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.certfile = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.delay_auth_decision = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.http_connect_timeout = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.identity_uri = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.include_service_catalog = True {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.insecure = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.interface = public {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.keyfile = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.memcache_password = {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.memcache_username = {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.region_name = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.service_token_roles_required = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.service_type = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.token_cache_time = 300 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.99/identity {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.backend = dogpile.cache.null {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.backend_argument = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.backend_expiration_time = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.config_prefix = cache.oslo {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.debug_cache_backend = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.enable_retry_client = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.enable_socket_keepalive = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.enabled = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.enforce_fips_mode = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.expiration_time = 600 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.hashclient_retry_attempts = 2 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.memcache_dead_retry = 300 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.memcache_pool_maxsize = 10 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.memcache_sasl_enabled = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.password = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.proxies = [] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.redis_db = 0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.redis_sentinel_service_name = mymaster {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.redis_server = localhost:6379 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.retry_attempts = 2 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.retry_delay = 0.0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.socket_keepalive_count = 1 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.socket_keepalive_idle = 1 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.socket_keepalive_interval = 1 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.socket_timeout = 1.0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.tls_allowed_ciphers = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.tls_cafile = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.tls_certfile = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.tls_enabled = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.tls_keyfile = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cache.username = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] coordination.backend_url = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.asyncio_connection = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.asyncio_slave_connection = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.backend = sqlalchemy {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.connection = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.connection_debug = 0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.connection_parameters = {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.connection_recycle_time = 3600 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.connection_trace = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.db_inc_retry_interval = True {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.db_max_retries = 20 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.db_max_retry_interval = 10 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.db_retry_interval = 1 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.max_overflow = 50 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.max_pool_size = 5 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.max_retries = 10 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.mysql_wsrep_sync_wait = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.pool_timeout = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.retry_interval = 10 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.slave_connection = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.sqlite_synchronous = True {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.synchronous_reader = True {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] database.use_db_reconnect = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] profiler.connection_string = messaging:// {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] profiler.enabled = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] profiler.es_doc_type = notification {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] profiler.es_scroll_size = 10000 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] profiler.es_scroll_time = 2m {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] profiler.filter_error_trace = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] profiler.hmac_keys = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] profiler.sentinel_service_name = mymaster {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] profiler.socket_timeout = 0.1 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] profiler.trace_requests = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] profiler.trace_sqlalchemy = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] profiler_jaeger.process_tags = {} {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] profiler_jaeger.service_name_prefix = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] profiler_otlp.service_name_prefix = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_policy.enforce_new_defaults = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: WARNING oslo_config.cfg [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_policy.enforce_scope = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_policy.policy_default_rule = default {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_policy.policy_file = policy.yaml {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_policy.remote_timeout = 60.0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] privsep_osbrick.group = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] privsep_osbrick.helper_command = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] privsep_osbrick.user = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cinder_sys_admin.group = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cinder_sys_admin.helper_command = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] cinder_sys_admin.user = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] service_user.auth_section = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] service_user.auth_type = password {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] service_user.cafile = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] service_user.certfile = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] service_user.collect_timing = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] service_user.insecure = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] service_user.keyfile = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] service_user.send_service_user_token = True {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] service_user.split_loggers = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] service_user.timeout = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] glance.auth_section = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] glance.auth_type = password {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] glance.certfile = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] glance.collect_timing = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] glance.insecure = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] glance.keyfile = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] glance.region_name = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] glance.split_loggers = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] glance.timeout = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.backend_availability_zone = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.chap_password = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.chap_username = {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.disk_geometry = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.driver_client_cert = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.driver_client_cert_key = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.driver_data_namespace = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.driver_use_ssl = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.enable_unsupported_driver = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.extra_capabilities = {} {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.filter_function = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.goodness_function = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.iscsi_target_flags = {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.iscsi_write_cache = on {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.iser_helper = tgtadm {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.iser_ip_address = 192.168.122.99 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.iser_port = 3260 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.nas_host = {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.nas_login = admin {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.nas_mount_options = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.nas_password = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.nas_private_key = {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.nas_share_path = {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.nas_ssh_port = 22 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.num_shell_tries = 3 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.nvmet_port_id = 1 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.quobyte_client_cfg = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.quobyte_volume_url = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.replication_device = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.report_discard_supported = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.reserved_percentage = 0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.scst_target_driver = iscsi {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.scst_target_iqn_name = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.storage_protocol = iSCSI {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.target_helper = tgtadm {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.target_ip_address = 192.168.122.99 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.target_port = 3260 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.target_protocol = iscsi {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.trace_flags = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.unique_fqdn_network = True {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.use_chap_auth = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.volume_backend_name = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.volume_clear = zero {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.volume_clear_ionice = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.volume_clear_size = 0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_reports.file_event_handler = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_reports.log_dir = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.backend_availability_zone = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.backend_host = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.chap_password = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.chap_username = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.chiscsi_conf = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.disk_geometry = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.driver_client_cert = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.driver_client_cert_key = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.driver_data_namespace = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.driver_use_ssl = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.extra_capabilities = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.filter_function = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.goodness_function = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.iscsi_target_flags = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.iscsi_write_cache = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.iser_helper = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.iser_ip_address = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.iser_port = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.iser_target_prefix = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.nas_host = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.nas_login = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.nas_mount_options = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.nas_password = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.nas_private_key = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.nas_share_path = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.nas_ssh_port = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.num_shell_tries = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.nvmet_ns_id = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.nvmet_port_id = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.replication_device = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.report_discard_supported = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.reserved_percentage = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.scst_target_driver = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.storage_protocol = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.target_helper = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.target_ip_address = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.target_port = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.target_prefix = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.target_protocol = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.trace_flags = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.unique_fqdn_network = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.use_chap_auth = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.volume_clear = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.volume_clear_ionice = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.volume_clear_size = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] QuobyteHD.volumes_dir = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.ssl = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.ssl_version = {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_notifications.driver = [] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_notifications.retry = -1 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] oslo_messaging_notifications.transport_url = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] key_manager.fixed_key = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican.barbican_api_version = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican.barbican_endpoint = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican.barbican_endpoint_type = public {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican.barbican_region_name = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican.cafile = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican.certfile = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican.collect_timing = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican.insecure = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican.keyfile = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican.number_of_retries = 60 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican.retry_delay = 1 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican.send_service_user_token = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican.split_loggers = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican.timeout = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican.verify_ssl = True {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican.verify_ssl_path = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican_service_user.auth_section = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican_service_user.auth_type = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican_service_user.cafile = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican_service_user.certfile = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican_service_user.collect_timing = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican_service_user.insecure = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican_service_user.keyfile = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican_service_user.split_loggers = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] barbican_service_user.timeout = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] vault.approle_role_id = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] vault.approle_secret_id = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] vault.kv_mountpoint = secret {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] vault.kv_path = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] vault.kv_version = 2 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] vault.namespace = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] vault.root_token_id = **** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] vault.ssl_ca_crt_file = None {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] vault.timeout = 60.0 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] vault.use_ssl = False {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:42 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] ******************************************************************************** {{(pid=81372) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 28 05:46:42 devstack quobyte-client[81492]: Reading configuration file: /etc/quobyte/client.cfg Apr 28 05:46:42 devstack quobyte-client[81492]: Invalid parameters found, error: missing mount point. Apr 28 05:46:42 devstack quobyte-client[81492]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 28 05:46:42 devstack quobyte-client[81492]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 28 05:46:42 devstack cinder-volume[81491]: DEBUG oslo_concurrency.processutils [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] CMD "mount.quobyte" returned: 1 in 0.192s {{(pid=81491) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:46:42 devstack cinder-volume[81491]: DEBUG oslo_concurrency.lockutils [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81491) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:46:42 devstack cinder-volume[81491]: DEBUG oslo_concurrency.lockutils [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81491) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:46:42 devstack cinder-volume[81491]: DEBUG cinder.volume.drivers.quobyte [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81491) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:46:42 devstack cinder-volume[81491]: INFO cinder.volume.drivers.quobyte [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 ... Apr 28 05:46:42 devstack cinder-volume[81491]: DEBUG oslo_concurrency.processutils [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 -c /etc/quobyte/client-cinder.cfg {{(pid=81491) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:46:42 devstack sudo[81493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 -c /etc/quobyte/client-cinder.cfg Apr 28 05:46:42 devstack sudo[81493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:46:43 devstack sudo[81493]: pam_unix(sudo:session): session closed for user root Apr 28 05:46:43 devstack cinder-volume[81491]: DEBUG oslo_concurrency.processutils [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.566s {{(pid=81491) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:46:43 devstack cinder-volume[81491]: INFO cinder.volume.drivers.quobyte [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 succeeded Apr 28 05:46:43 devstack cinder-volume[81491]: DEBUG cinder.volume.drivers.quobyte [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81491) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:46:43 devstack cinder-volume[81491]: DEBUG oslo_concurrency.lockutils [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.576s {{(pid=81491) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:46:43 devstack cinder-volume[81491]: DEBUG oslo_concurrency.processutils [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81491) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:46:43 devstack sudo[81562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:46:43 devstack sudo[81562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:46:43 devstack sudo[81562]: pam_unix(sudo:session): session closed for user root Apr 28 05:46:43 devstack cinder-volume[81491]: DEBUG oslo_concurrency.processutils [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.427s {{(pid=81491) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:46:43 devstack cinder-volume[81491]: INFO cinder.volume.driver [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Driver hasn't implemented _init_vendor_properties() Apr 28 05:46:43 devstack cinder-volume[81491]: DEBUG cinder.volume.driver [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732765197754, 'free_capacity_gb': 1775.732765197754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81491) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 28 05:46:43 devstack cinder-volume[81491]: DEBUG oslo_db.sqlalchemy.engines [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81491) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 05:46:43 devstack cinder-volume[81491]: DEBUG dbcounter [-] [81491] Writer thread running {{(pid=81491) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 28 05:46:43 devstack cinder-volume[81491]: DEBUG cinder.db.sqlalchemy.api [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Building query based on filter {{(pid=81491) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 28 05:46:44 devstack cinder-volume[81491]: DEBUG cinder.image.image_utils [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81491) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 28 05:46:44 devstack cinder-volume[81491]: INFO cinder.keymgr.migration [None req-379a1bcf-b170-4f15-a8f6-4843c172f79a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 28 05:46:44 devstack cinder-volume[81491]: DEBUG oslo_concurrency.lockutils [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81491) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:46:44 devstack cinder-volume[81491]: DEBUG oslo_concurrency.lockutils [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81491) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:46:44 devstack cinder-volume[81491]: DEBUG cinder.volume.drivers.quobyte [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81491) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:46:44 devstack cinder-volume[81491]: DEBUG cinder.volume.drivers.quobyte [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81491) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:46:44 devstack cinder-volume[81491]: DEBUG oslo_concurrency.lockutils [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81491) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:46:44 devstack cinder-volume[81491]: DEBUG oslo_concurrency.processutils [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81491) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:46:44 devstack sudo[81565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:46:44 devstack sudo[81565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:46:44 devstack sudo[81565]: pam_unix(sudo:session): session closed for user root Apr 28 05:46:44 devstack cinder-volume[81491]: DEBUG oslo_concurrency.processutils [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.418s {{(pid=81491) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:46:44 devstack cinder-volume[81491]: DEBUG cinder.manager [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Notifying Schedulers of capabilities ... {{(pid=81491) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:46:44 devstack cinder-volume[81491]: INFO cinder.volume.manager [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Driver initialization completed successfully. Apr 28 05:46:44 devstack cinder-volume[81491]: INFO cinder.manager [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Initiating service 3 cleanup Apr 28 05:46:44 devstack cinder-volume[81491]: INFO cinder.manager [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Service 3 cleanup completed. Apr 28 05:46:44 devstack cinder-volume[81491]: DEBUG cinder.service [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Creating RPC server for service cinder-volume {{(pid=81491) start /opt/stack/cinder/cinder/service.py:231}} Apr 28 05:46:44 devstack cinder-volume[81491]: DEBUG cinder.service [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81491) start /opt/stack/cinder/cinder/service.py:237}} Apr 28 05:46:44 devstack cinder-volume[81491]: INFO cinder.volume.manager [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 28 05:46:44 devstack cinder-volume[81491]: DEBUG oslo_concurrency.lockutils [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81491) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:46:44 devstack cinder-volume[81491]: DEBUG oslo_concurrency.lockutils [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81491) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:46:44 devstack cinder-volume[81491]: DEBUG cinder.volume.drivers.quobyte [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81491) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:46:44 devstack cinder-volume[81491]: DEBUG cinder.volume.drivers.quobyte [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81491) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:46:44 devstack cinder-volume[81491]: DEBUG oslo_concurrency.lockutils [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81491) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:46:44 devstack cinder-volume[81491]: DEBUG oslo_concurrency.processutils [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81491) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:46:44 devstack sudo[81572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:46:44 devstack sudo[81572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:46:44 devstack sudo[81572]: pam_unix(sudo:session): session closed for user root Apr 28 05:46:44 devstack cinder-volume[81491]: DEBUG oslo_concurrency.processutils [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.406s {{(pid=81491) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:46:44 devstack cinder-volume[81491]: INFO cinder.volume.manager [None req-0b5e8ecb-e610-426e-98ee-ddee035e91bf None None] Driver post RPC initialization completed successfully. Apr 28 05:46:48 devstack cinder-volume[81372]: INFO oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Caught SIGTERM, stopping children Apr 28 05:46:48 devstack cinder-volume[81372]: DEBUG oslo_concurrency.lockutils [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Acquiring lock "singleton_lock" {{(pid=81372) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 05:46:48 devstack cinder-volume[81372]: DEBUG oslo_concurrency.lockutils [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Acquired lock "singleton_lock" {{(pid=81372) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 05:46:48 devstack cinder-volume[81372]: DEBUG oslo_concurrency.lockutils [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Releasing lock "singleton_lock" {{(pid=81372) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 05:46:48 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Stop services. {{(pid=81372) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 28 05:46:48 devstack cinder-volume[81372]: DEBUG oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Killing children. {{(pid=81372) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 28 05:46:48 devstack cinder-volume[81372]: INFO oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Waiting on 1 children to exit Apr 28 05:46:48 devstack cinder-volume[81491]: DEBUG oslo_concurrency.lockutils [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Acquiring lock "singleton_lock" {{(pid=81491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 05:46:48 devstack cinder-volume[81491]: DEBUG oslo_concurrency.lockutils [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Acquired lock "singleton_lock" {{(pid=81491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 05:46:48 devstack cinder-volume[81491]: DEBUG oslo_concurrency.lockutils [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Releasing lock "singleton_lock" {{(pid=81491) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 05:46:48 devstack cinder-volume[81491]: WARNING amqp [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 28 05:46:48 devstack cinder-volume[81491]: WARNING amqp [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 28 05:46:48 devstack cinder-volume[81372]: INFO oslo_service.backend._eventlet.service [None req-a67b4c57-34a9-47a8-924c-9e297d0c833a None None] Child 81491 exited with status 0 Apr 28 05:46:48 devstack cinder-volume[81707]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 28 05:46:48 devstack cinder-volume[81707]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 28 05:46:48 devstack cinder-volume[81707]: we strongly recommend against using it for new projects. Apr 28 05:46:48 devstack cinder-volume[81707]: If you are already using Eventlet, we recommend migrating to a different Apr 28 05:46:48 devstack cinder-volume[81707]: framework. For more detail see Apr 28 05:46:48 devstack cinder-volume[81707]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 28 05:46:48 devstack cinder-volume[81707]: import eventlet # noqa Apr 28 05:46:50 devstack cinder-volume[81707]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81707) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 28 05:46:50 devstack cinder-volume[81707]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81707) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 28 05:46:50 devstack cinder-volume[81707]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81707) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 28 05:46:51 devstack cinder-volume[81707]: INFO dbcounter [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] Registered counter for database cinder Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_db.sqlalchemy.engines [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81707) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG dbcounter [-] [81707] Writer thread running {{(pid=81707) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 28 05:46:51 devstack cinder-volume[81707]: INFO cinder.rpc [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 28 05:46:51 devstack cinder-volume[81707]: INFO cinder.rpc [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_db.sqlalchemy.engines [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81707) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 05:46:51 devstack cinder-volume[81707]: INFO cinder.volume.manager [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] Determined volume DB was empty at startup. Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG cinder.volume.manager [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81707) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 28 05:46:51 devstack cinder-volume[81707]: WARNING stevedore.named [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 28 05:46:51 devstack cinder-volume[81707]: WARNING castellan.key_manager [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 05:46:51 devstack cinder-volume[81707]: WARNING cinder.keymgr.conf_key_mgr [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 28 05:46:51 devstack cinder-volume[81707]: INFO cinder.volume.manager [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_db.sqlalchemy.engines [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81707) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 05:46:51 devstack cinder-volume[81707]: INFO oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] Starting 1 workers Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] Started child 81829 {{(pid=81707) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] Full set of CONF: {{(pid=81707) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] ******************************************************************************** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] Configuration options gathered from: {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] ================================================================================ {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] allow_availability_zone_fallback = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] allow_compression_on_image_upload = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] allowed_direct_url_schemes = [] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] api_rate_limit = True {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] auth_strategy = keystone {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_availability_zone = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_host = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_name = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_stats_polling_interval = 60 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backup_api_class = cinder.backup.api.API {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backup_name_template = backup-%s {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backup_use_same_host = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backup_use_temp_snapshot = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] chap_password = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] chap_username = {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cinder_internal_tenant_project_id = a56fd1234285459d9245db6ac002ccd8 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cinder_internal_tenant_user_id = 84d2f9c7be9f484694586e5815ede83b {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cluster = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] compression_format = gzip {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] compute_api_class = cinder.compute.nova.API {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] config_dir = [] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] config_source = [] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] control_exchange = openstack {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] debug = True {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] default_availability_zone = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] default_group_type = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] default_volume_type = QuobyteHD {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] disk_geometry = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] driver_client_cert = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] driver_client_cert_key = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] driver_data_namespace = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] driver_ssl_cert_path = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] driver_ssl_cert_verify = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] driver_use_ssl = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] enable_new_services = True {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] enable_unsupported_driver = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] enabled_backends = ['QuobyteHD'] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81829]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] enforce_multipath_for_image_xfer = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] filter_function = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] glance_api_insecure = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] glance_api_servers = ['http://192.168.122.99/image'] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] glance_api_ssl_compression = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] glance_ca_certificates_file = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] glance_catalog_info = image:glance:publicURL {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] glance_certfile = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] glance_keyfile = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] glance_num_retries = 3 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] glance_request_timeout = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] goodness_function = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] graceful_shutdown_timeout = 5 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] group_api_class = cinder.group.api.API {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] host = devstack {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] image_compress_on_upload = True {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] image_conversion_address_space_limit = 1 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] image_conversion_cpu_limit = 60 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] image_conversion_disable = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] image_upload_use_cinder_backend = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] image_upload_use_internal_tenant = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] image_volume_cache_enabled = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] image_volume_cache_max_count = 0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] image_volume_cache_max_size_gb = 0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] init_host_max_objects_retrieval = 0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] instance_format = [instance: %(uuid)s] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] iscsi_target_flags = {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] iscsi_write_cache = on {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] iser_helper = tgtadm {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] iser_ip_address = 192.168.122.99 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] iser_port = 3260 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] log_color = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] log_config_append = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] log_dir = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] log_file = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] log_options = True {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] log_rotate_interval = 1 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] log_rotate_interval_type = days {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] log_rotation_type = none {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] max_age = 0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] max_logfile_count = 30 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] max_logfile_size_mb = 200 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] max_over_subscription_ratio = 20.0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] message_reap_interval = 86400 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] message_ttl = 2592000 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] migration_create_volume_timeout_secs = 300 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] monkey_patch = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] monkey_patch_modules = [] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] my_ip = 192.168.122.99 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] no_snapshot_gb_quota = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] num_iser_scan_tries = 3 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] num_shell_tries = 3 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] num_volume_device_scan_tries = 3 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] nvmeof_conn_info_version = 1 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] nvmet_ns_id = 10 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] nvmet_port_id = 1 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] osapi_max_limit = 1000 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] osapi_volume_ext_list = [] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Starting volume driver QuobyteDriver (1.1.14) Apr 28 05:46:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81829) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] osapi_volume_listen_port = 8776 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] osapi_volume_use_ssl = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] osapi_volume_workers = 2 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] per_volume_size_limit = -1 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] periodic_fuzzy_delay = 60 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] periodic_interval = 60 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] public_endpoint = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] publish_errors = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] quota_backup_gigabytes = 1000 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] quota_backups = 10 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] quota_gigabytes = 1000 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] quota_groups = 10 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] quota_snapshots = 10 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] quota_volumes = 10 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] rate_limit_burst = 0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] rate_limit_except_level = CRITICAL {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] rate_limit_interval = 0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] reinit_driver_count = 3 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] replication_device = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] report_discard_supported = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] report_interval = 120 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] reservation_clean_interval = 86400 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] reservation_expire = 86400 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] reserved_image_namespaces = [] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] reserved_percentage = 0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] rpc_response_timeout = 120 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] run_external_periodic_tasks = True {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] scst_target_driver = iscsi {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] scst_target_iqn_name = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] service_down_time = 720 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] shell_completion = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] snapshot_name_template = snapshot-%s {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] split_loggers = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] state_path = /opt/stack/data/cinder {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] storage_availability_zone = nova {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] storage_protocol = iSCSI {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] syslog_log_facility = LOG_USER {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] target_helper = lioadm {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] target_ip_address = 192.168.122.99 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] target_port = 3260 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] target_protocol = iscsi {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] target_secondary_ip_addresses = [] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] trace_flags = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] transport_url = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] until_refresh = 0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] use_chap_auth = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] use_default_quota_class = True {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] use_journal = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] use_json = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] use_multipath_for_image_xfer = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] use_stderr = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] use_syslog = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] verify_glance_signatures = enabled {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] volume_api_class = cinder.volume.api.API {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] volume_backend_name = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] volume_clear = zero {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] volume_clear_ionice = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] volume_clear_size = 0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] volume_copy_bps_limit = 0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] volume_dd_blocksize = 1M {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] volume_name_template = volume-%s {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] volume_service_inithost_offload = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] volume_usage_audit_period = month {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] zoning_mode = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_concurrency.disable_process_locking = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.admin_password = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.admin_token = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.admin_user = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.auth_port = 35357 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.auth_protocol = https {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.auth_section = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.auth_type = password {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.auth_uri = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.auth_version = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.cache = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.certfile = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.identity_uri = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.include_service_catalog = True {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.insecure = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.interface = public {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.keyfile = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.memcache_password = {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.memcache_username = {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.region_name = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.service_type = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.99/identity {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.backend = dogpile.cache.null {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.backend_argument = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.backend_expiration_time = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.config_prefix = cache.oslo {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.debug_cache_backend = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.enable_retry_client = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.enable_socket_keepalive = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.enabled = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.enforce_fips_mode = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.expiration_time = 600 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.hashclient_retry_attempts = 2 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.memcache_dead_retry = 300 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.memcache_pool_maxsize = 10 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.memcache_sasl_enabled = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.password = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.proxies = [] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.redis_db = 0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.redis_server = localhost:6379 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.retry_attempts = 2 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81829) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 28 05:46:51 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.quobyte [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 28 05:46:51 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.quobyte [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 28 05:46:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Running cmd (subprocess): mount.quobyte {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.retry_delay = 0.0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.socket_keepalive_count = 1 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.socket_keepalive_idle = 1 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.socket_keepalive_interval = 1 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.socket_timeout = 1.0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.tls_allowed_ciphers = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.tls_cafile = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.tls_certfile = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.tls_enabled = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.tls_keyfile = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cache.username = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] coordination.backend_url = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.asyncio_connection = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.asyncio_slave_connection = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.backend = sqlalchemy {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.connection = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.connection_debug = 0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.connection_parameters = {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.connection_recycle_time = 3600 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.connection_trace = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.db_inc_retry_interval = True {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.db_max_retries = 20 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.db_max_retry_interval = 10 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.db_retry_interval = 1 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.max_overflow = 50 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.max_pool_size = 5 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.max_retries = 10 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.mysql_wsrep_sync_wait = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.pool_timeout = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.retry_interval = 10 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.slave_connection = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.sqlite_synchronous = True {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.synchronous_reader = True {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] database.use_db_reconnect = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] profiler.connection_string = messaging:// {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] profiler.enabled = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] profiler.es_doc_type = notification {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] profiler.es_scroll_size = 10000 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] profiler.es_scroll_time = 2m {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] profiler.filter_error_trace = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] profiler.hmac_keys = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] profiler.sentinel_service_name = mymaster {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] profiler.socket_timeout = 0.1 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] profiler.trace_requests = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] profiler.trace_sqlalchemy = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] profiler_jaeger.process_tags = {} {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] profiler_jaeger.service_name_prefix = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] profiler_otlp.service_name_prefix = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_policy.enforce_new_defaults = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: WARNING oslo_config.cfg [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_policy.enforce_scope = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_policy.policy_default_rule = default {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_policy.policy_file = policy.yaml {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] privsep_osbrick.group = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] privsep_osbrick.helper_command = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] privsep_osbrick.user = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cinder_sys_admin.group = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cinder_sys_admin.helper_command = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] cinder_sys_admin.user = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] service_user.auth_section = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] service_user.auth_type = password {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] service_user.cafile = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] service_user.certfile = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] service_user.collect_timing = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] service_user.insecure = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] service_user.keyfile = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] service_user.send_service_user_token = True {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] service_user.split_loggers = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] service_user.timeout = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] glance.auth_section = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] glance.auth_type = password {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] glance.certfile = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] glance.collect_timing = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] glance.insecure = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] glance.keyfile = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] glance.region_name = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] glance.split_loggers = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] glance.timeout = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.backend_availability_zone = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.chap_password = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.chap_username = {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.disk_geometry = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.driver_client_cert = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.driver_client_cert_key = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.driver_data_namespace = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.driver_use_ssl = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.extra_capabilities = {} {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.filter_function = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.goodness_function = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.iscsi_target_flags = {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.iscsi_write_cache = on {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.iser_helper = tgtadm {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.iser_ip_address = 192.168.122.99 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.iser_port = 3260 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.nas_host = {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.nas_login = admin {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.nas_mount_options = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.nas_password = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.nas_private_key = {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.nas_share_path = {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.num_shell_tries = 3 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.quobyte_volume_url = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.replication_device = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.report_discard_supported = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.reserved_percentage = 0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.target_helper = tgtadm {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.target_ip_address = 192.168.122.99 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.target_port = 3260 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.target_protocol = iscsi {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.trace_flags = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.unique_fqdn_network = True {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.use_chap_auth = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.volume_backend_name = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.volume_clear = zero {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.volume_clear_ionice = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.volume_clear_size = 0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_reports.file_event_handler = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_reports.log_dir = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.backend_availability_zone = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.backend_host = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.chap_password = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.chap_username = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.chiscsi_conf = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.disk_geometry = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.driver_client_cert = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.driver_data_namespace = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.driver_use_ssl = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.extra_capabilities = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.filter_function = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.goodness_function = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.iser_helper = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.iser_ip_address = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.iser_port = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.iser_target_prefix = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.nas_host = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.nas_login = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.nas_mount_options = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.nas_password = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.nas_private_key = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.nas_share_path = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.nas_ssh_port = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.num_shell_tries = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack quobyte-client[81830]: Reading configuration file: /etc/quobyte/client.cfg Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.nvmet_port_id = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack quobyte-client[81830]: Invalid parameters found, error: missing mount point. Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.replication_device = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.report_discard_supported = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.reserved_percentage = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.scst_target_driver = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack quobyte-client[81830]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.storage_protocol = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.target_helper = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.target_ip_address = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.target_port = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.target_prefix = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack quobyte-client[81830]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.target_protocol = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.trace_flags = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.use_chap_auth = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.volume_clear = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.volume_clear_size = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] QuobyteHD.volumes_dir = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] CMD "mount.quobyte" returned: 1 in 0.108s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:46:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:46:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:46:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.ssl = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_notifications.driver = [] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_notifications.retry = -1 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] key_manager.fixed_key = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican.barbican_api_version = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican.barbican_endpoint = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican.barbican_endpoint_type = public {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican.barbican_region_name = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican.cafile = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican.certfile = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican.collect_timing = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican.insecure = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican.keyfile = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican.number_of_retries = 60 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican.retry_delay = 1 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican.send_service_user_token = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican.split_loggers = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican.timeout = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican.verify_ssl = True {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican.verify_ssl_path = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican_service_user.auth_section = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican_service_user.auth_type = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican_service_user.cafile = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican_service_user.certfile = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican_service_user.collect_timing = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican_service_user.insecure = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican_service_user.keyfile = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican_service_user.split_loggers = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] barbican_service_user.timeout = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] vault.approle_role_id = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] vault.approle_secret_id = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] vault.kv_mountpoint = secret {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] vault.kv_path = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] vault.kv_version = 2 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] vault.namespace = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] vault.root_token_id = **** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] vault.ssl_ca_crt_file = None {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] vault.timeout = 60.0 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] vault.use_ssl = False {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 28 05:46:51 devstack cinder-volume[81707]: DEBUG oslo_service.backend._eventlet.service [None req-365fc19b-b326-470b-a92e-de8286cd80f0 None None] ******************************************************************************** {{(pid=81707) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 28 05:46:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:46:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:46:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:46:51 devstack sudo[81841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:46:51 devstack sudo[81841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:46:52 devstack sudo[81841]: pam_unix(sudo:session): session closed for user root Apr 28 05:46:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.488s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:46:52 devstack cinder-volume[81829]: INFO cinder.volume.driver [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Driver hasn't implemented _init_vendor_properties() Apr 28 05:46:52 devstack cinder-volume[81829]: DEBUG cinder.volume.driver [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732765197754, 'free_capacity_gb': 1775.732765197754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81829) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 28 05:46:52 devstack cinder-volume[81829]: DEBUG oslo_db.sqlalchemy.engines [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81829) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 28 05:46:52 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writer thread running {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 28 05:46:52 devstack cinder-volume[81829]: DEBUG cinder.db.sqlalchemy.api [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Building query based on filter {{(pid=81829) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 28 05:46:52 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81829) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 28 05:46:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:46:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:46:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:46:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:46:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:46:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:46:52 devstack cinder-volume[81829]: INFO cinder.keymgr.migration [None req-26892716-8283-458c-b4ca-8cc29e2f60d9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 28 05:46:52 devstack sudo[81864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:46:52 devstack sudo[81864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:46:53 devstack sudo[81864]: pam_unix(sudo:session): session closed for user root Apr 28 05:46:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.665s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:46:53 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:46:53 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Driver initialization completed successfully. Apr 28 05:46:53 devstack cinder-volume[81829]: INFO cinder.manager [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Initiating service 3 cleanup Apr 28 05:46:53 devstack cinder-volume[81829]: INFO cinder.manager [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Service 3 cleanup completed. Apr 28 05:46:53 devstack cinder-volume[81829]: DEBUG cinder.service [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Creating RPC server for service cinder-volume {{(pid=81829) start /opt/stack/cinder/cinder/service.py:231}} Apr 28 05:46:53 devstack cinder-volume[81829]: DEBUG cinder.service [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81829) start /opt/stack/cinder/cinder/service.py:237}} Apr 28 05:46:53 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 28 05:46:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:46:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:46:53 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:46:53 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:46:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:46:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:46:53 devstack sudo[81948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:46:53 devstack sudo[81948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:46:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.529s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:46:53 devstack sudo[81948]: pam_unix(sudo:session): session closed for user root Apr 28 05:46:53 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-c4c8abdb-8775-41bd-8b50-8769dddb8d2d None None] Driver post RPC initialization completed successfully. Apr 28 05:47:01 devstack cinder-volume[81707]: DEBUG dbcounter [-] [81707] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81707) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:47:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b03c87a8-3bc0-4e02-bfc1-9e2b9699f64c tempest-BackendsCapabilitiesAdminTestsJSON-83780158 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732765197754, 'free_capacity_gb': 1775.732765197754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81829) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 28 05:47:03 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:SELECT=3 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:47:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-71ad298e-4085-44b1-941c-4c6c540073e3 tempest-BackendsCapabilitiesAdminTestsJSON-83780158 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732765197754, 'free_capacity_gb': 1775.732765197754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81829) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 28 05:47:03 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:47:53 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-894a843d-0eba-4eb3-ac35-270c86d99560 tempest-GroupSnapshotsTest-882628920 None] Group tempest-GroupSnapshotsTest-Group-413842235: creating Apr 28 05:47:53 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-894a843d-0eba-4eb3-ac35-270c86d99560 tempest-GroupSnapshotsTest-882628920 None] Group tempest-GroupSnapshotsTest-Group-413842235: created successfully Apr 28 05:47:53 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-894a843d-0eba-4eb3-ac35-270c86d99560 tempest-GroupSnapshotsTest-882628920 None] Create group completed successfully. Apr 28 05:47:54 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:47:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Flow 'volume_create_manager' (a355b534-a992-496f-b129-87b614db6128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:47:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2905a13-9e3f-4e30-a2f3-f370eab07ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:47:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2905a13-9e3f-4e30-a2f3-f370eab07ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-902276404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f246026-dd73-45c5-ad63-366aec55a717,host='devstack@QuobyteHD#QuobyteHD',id=03193659-513d-4921-b057-c820d43dc6c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a157ae164ce43c59f23b818b0d5ae82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:47:55Z,use_quota=True,user_id='cd08c541834b4f77b3df300b97fe4341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02282e06-4d95-46d0-a076-af425fe2525e),volume_type_id=02282e06-4d95-46d0-a076-af425fe2525e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:47:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7a0b6d-ac93-4fd6-8538-1c890766a199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:47:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7a0b6d-ac93-4fd6-8538-1c890766a199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:47:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e7e2a2-8956-4887-acbc-d81b96ff8433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:47:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e7e2a2-8956-4887-acbc-d81b96ff8433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03193659-513d-4921-b057-c820d43dc6c9', 'volume_name': 'volume-03193659-513d-4921-b057-c820d43dc6c9', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:47:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c75759-949e-4291-9a9a-8d1adfcc8e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:47:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c75759-949e-4291-9a9a-8d1adfcc8e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:47:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4865bbd3-7ca8-4dcd-8257-3ef77ea00fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:47:54 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Volume 03193659-513d-4921-b057-c820d43dc6c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03193659-513d-4921-b057-c820d43dc6c9', 'volume_size': 1} Apr 28 05:47:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:47:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:47:55 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0f246026-dd73-45c5-ad63-366aec55a717,created_at=2026-04-28T03:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-902276404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f246026-dd73-45c5-ad63-366aec55a717,host='devstack@QuobyteHD#QuobyteHD',id=03193659-513d-4921-b057-c820d43dc6c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a157ae164ce43c59f23b818b0d5ae82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:47:55Z,use_quota=True,user_id='cd08c541834b4f77b3df300b97fe4341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02282e06-4d95-46d0-a076-af425fe2525e),volume_type_id=02282e06-4d95-46d0-a076-af425fe2525e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:47:55 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Creating volume 03193659-513d-4921-b057-c820d43dc6c9 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:47:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:47:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:47:55 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:47:55 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:47:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:47:55 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:47:55 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:47:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:47:55 devstack sudo[82340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9 1073741824 Apr 28 05:47:55 devstack sudo[82340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:47:55 devstack sudo[82340]: pam_unix(sudo:session): session closed for user root Apr 28 05:47:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9 1073741824" returned: 0 in 0.822s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:47:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:47:55 devstack sudo[82675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9 Apr 28 05:47:55 devstack sudo[82675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:47:56 devstack sudo[82675]: pam_unix(sudo:session): session closed for user root Apr 28 05:47:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9" returned: 0 in 0.643s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:47:56 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:47:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:47:56 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4865bbd3-7ca8-4dcd-8257-3ef77ea00fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03193659-513d-4921-b057-c820d43dc6c9', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:47:56 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620844a8-e090-49d6-9013-3ff363548ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:47:56 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Volume volume-03193659-513d-4921-b057-c820d43dc6c9 (03193659-513d-4921-b057-c820d43dc6c9): created successfully Apr 28 05:47:56 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620844a8-e090-49d6-9013-3ff363548ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:47:56 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Flow 'volume_create_manager' (a355b534-a992-496f-b129-87b614db6128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:47:56 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-8fd78137-6415-458a-b130-dfabd30cdecf tempest-GroupSnapshotsTest-882628920 None] Created volume successfully. Apr 28 05:47:57 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] GroupSnapshot 9c8ff16a-978f-443f-89fa-d4336c33d619: creating. Apr 28 05:47:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] Group snapshot 9c8ff16a-978f-443f-89fa-d4336c33d619: creating. {{(pid=81829) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 28 05:47:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:47:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:47:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] Creating offline snapshot 5fe4cda1-674a-4b46-badc-c8c711c5bd2c of volume 03193659-513d-4921-b057-c820d43dc6c9 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:47:57 devstack cinder-volume[81829]: INFO oslo.privsep.daemon [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpn5_kemmc/privsep.sock'] Apr 28 05:47:57 devstack sudo[82687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpn5_kemmc/privsep.sock Apr 28 05:47:57 devstack sudo[82687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:47:57 devstack cinder-volume[81829]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 28 05:47:57 devstack cinder-volume[81829]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 28 05:47:57 devstack cinder-volume[81829]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 28 05:47:57 devstack cinder-volume[81829]: WARNING oslo.privsep.daemon [-] privsep log: Apr 28 05:47:57 devstack cinder-volume[81829]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 28 05:47:57 devstack cinder-volume[81829]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 28 05:47:57 devstack cinder-volume[81829]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 28 05:47:57 devstack cinder-volume[81829]: WARNING oslo.privsep.daemon [-] privsep log: Apr 28 05:47:57 devstack cinder-volume[81829]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 28 05:47:58 devstack cinder-volume[81829]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 28 05:47:58 devstack cinder-volume[81829]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 28 05:47:58 devstack cinder-volume[81829]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 28 05:47:58 devstack cinder-volume[81829]: WARNING oslo.privsep.daemon [-] privsep log: Apr 28 05:47:58 devstack cinder-volume[81829]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 28 05:47:58 devstack cinder-volume[81829]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 28 05:47:58 devstack cinder-volume[81829]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 28 05:47:58 devstack cinder-volume[81829]: WARNING oslo.privsep.daemon [-] privsep log: Apr 28 05:47:58 devstack cinder-volume[81829]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 28 05:47:59 devstack sudo[82687]: pam_unix(sudo:session): session closed for user root Apr 28 05:47:59 devstack cinder-volume[81829]: INFO oslo.privsep.daemon [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] Spawned new privsep daemon via rootwrap Apr 28 05:47:59 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] Accepted privsep connection to /tmp/tmpn5_kemmc/privsep.sock {{(pid=81829) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 28 05:47:59 devstack cinder-volume[81829]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 28 05:47:59 devstack cinder-volume[81829]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 28 05:47:59 devstack cinder-volume[81829]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 28 05:47:59 devstack cinder-volume[81829]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82697 Apr 28 05:47:59 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a9592a-4b58-40e4-9e2a-527b1af71b34]: (2,) {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:47:59 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c020c3c-9ede-4609-9eb9-776678dd7487]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:47:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:47:59 devstack sudo[82703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9 Apr 28 05:47:59 devstack sudo[82703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:00 devstack sudo[82703]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9" returned: 0 in 0.961s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:00 devstack sudo[82719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c 1G Apr 28 05:48:00 devstack sudo[82719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:00 devstack sudo[82719]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c 1G" returned: 0 in 0.820s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03193659-513d-4921-b057-c820d43dc6c9 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:00 devstack sudo[82726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03193659-513d-4921-b057-c820d43dc6c9 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c Apr 28 05:48:00 devstack sudo[82726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:01 devstack sudo[82726]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03193659-513d-4921-b057-c820d43dc6c9 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c" returned: 0 in 0.989s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:01 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c is being set with open permissions: ugo+rw: NotImplementedError Apr 28 05:48:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:01 devstack sudo[82736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c Apr 28 05:48:01 devstack sudo[82736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:02 devstack sudo[82736]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c" returned: 0 in 0.907s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:02 devstack sudo[82750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.info Apr 28 05:48:02 devstack sudo[82750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:03 devstack sudo[82750]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.info" returned: 0 in 1.084s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:03 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 05:48:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:04 devstack sudo[82787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.info Apr 28 05:48:04 devstack sudo[82787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:05 devstack sudo[82787]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.info" returned: 0 in 1.098s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.629s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:05 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-82cff49b-9405-4141-8ede-538fe6d8fcc9 tempest-GroupSnapshotsTest-882628920 None] group_snapshot 9c8ff16a-978f-443f-89fa-d4336c33d619: created successfully Apr 28 05:48:06 devstack cinder-volume[81829]: DEBUG oslo_service.periodic_task [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81829) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 05:48:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:48:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:48:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:48:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:48:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:06 devstack sudo[82810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:48:06 devstack sudo[82810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:08 devstack sudo[82810]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 1.298s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "cinder-quobyte-5fe4cda1-674a-4b46-badc-c8c711c5bd2c-9412b479-d16b-4073-b55e-f0321eb639d8" by "_create_volume_from_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-5fe4cda1-674a-4b46-badc-c8c711c5bd2c-9412b479-d16b-4073-b55e-f0321eb639d8" acquired by "_create_volume_from_snapshot" :: waited 0.060s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Creating volume 9412b479-d16b-4073-b55e-f0321eb639d8 from snapshot 5fe4cda1-674a-4b46-badc-c8c711c5bd2c {{(pid=81829) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "cinder-quobyte-9412b479-d16b-4073-b55e-f0321eb639d8" by "_copy_volume_from_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-9412b479-d16b-4073-b55e-f0321eb639d8" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] snapshot: 5fe4cda1-674a-4b46-badc-c8c711c5bd2c, volume: 9412b479-d16b-4073-b55e-f0321eb639d8, {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad179053-120e-4e0f-92de-a8783f96ac46]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:48:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:08 devstack sudo[82816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c Apr 28 05:48:08 devstack sudo[82816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:09 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:48:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Flow 'volume_create_manager' (61d33986-186e-4261-8b76-ab8d8959858a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:48:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd82527c-b470-4cc6-888e-cf616a2d6eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd82527c-b470-4cc6-888e-cf616a2d6eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1436065050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09267435-4433-44f0-87f4-42ce6c6dbf35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='666cce9e393d47e9b576288407b2b4ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:48:09Z,use_quota=True,user_id='ae29bf9274654c978dc2aa016510f669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cf09cab-f21c-4244-a988-d89ba3a6241b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cf09cab-f21c-4244-a988-d89ba3a6241b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a81121f-f36a-4b51-b0c0-9810f29ef4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a81121f-f36a-4b51-b0c0-9810f29ef4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09267435-4433-44f0-87f4-42ce6c6dbf35', 'volume_name': 'volume-09267435-4433-44f0-87f4-42ce6c6dbf35', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffbf25f2-dea0-4ea0-88f2-56b9c9e1a19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffbf25f2-dea0-4ea0-88f2-56b9c9e1a19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29c86c4-2946-4cce-bb72-2ba0d7f354be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:09 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Volume 09267435-4433-44f0-87f4-42ce6c6dbf35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09267435-4433-44f0-87f4-42ce6c6dbf35', 'volume_size': 1} Apr 28 05:48:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:48:09 devstack sudo[82816]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c" returned: 0 in 1.243s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03193659-513d-4921-b057-c820d43dc6c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:48:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] will copy from snapshot at /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9 {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 05:48:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Creating direct copy from snapshot {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 05:48:09 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dcc7e5-689e-480e-9f57-4ebfae069719]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:48:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:10 devstack sudo[82823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9 Apr 28 05:48:10 devstack sudo[82823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:11 devstack sudo[82823]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9" returned: 0 in 1.539s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:11 devstack cinder-volume[81829]: DEBUG cinder.utils [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Path /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9412b479-d16b-4073-b55e-f0321eb639d8 not found in is_blk_device check {{(pid=81829) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 05:48:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9412b479-d16b-4073-b55e-f0321eb639d8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:11 devstack sudo[82855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9412b479-d16b-4073-b55e-f0321eb639d8 Apr 28 05:48:11 devstack sudo[82855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:19 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:SELECT=9,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:48:19 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:SELECT=17,cinder:UPDATE=4 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:48:20 devstack sudo[82855]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9412b479-d16b-4073-b55e-f0321eb639d8" returned: 0 in 8.871s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:20 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[161268cf-4844-42f0-a1f1-fa15ff32c2ce]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:48:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:20 devstack sudo[82965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9 Apr 28 05:48:20 devstack sudo[82965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:21 devstack sudo[82965]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9" returned: 0 in 0.912s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:21 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Image conversion details: src /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9, size 1024.00 MB, duration 8.87 sec, destination /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9412b479-d16b-4073-b55e-f0321eb639d8 {{(pid=81829) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:48:21 devstack cinder-volume[81829]: INFO cinder.image.image_utils [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Converted 1024.00 MB image at 115.42 MB/s Apr 28 05:48:21 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9412b479-d16b-4073-b55e-f0321eb639d8 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 05:48:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9412b479-d16b-4073-b55e-f0321eb639d8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:21 devstack sudo[83034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9412b479-d16b-4073-b55e-f0321eb639d8 Apr 28 05:48:21 devstack sudo[83034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:21 devstack sudo[83034]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9412b479-d16b-4073-b55e-f0321eb639d8" returned: 0 in 0.659s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-9412b479-d16b-4073-b55e-f0321eb639d8" released by "_copy_volume_from_snapshot" :: held 13.536s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:48:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-5fe4cda1-674a-4b46-badc-c8c711c5bd2c-9412b479-d16b-4073-b55e-f0321eb639d8" released by "_create_volume_from_snapshot" :: held 13.608s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:48:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.674s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.621s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:48:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1436065050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09267435-4433-44f0-87f4-42ce6c6dbf35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='666cce9e393d47e9b576288407b2b4ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:48:09Z,use_quota=True,user_id='ae29bf9274654c978dc2aa016510f669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:48:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Creating volume 09267435-4433-44f0-87f4-42ce6c6dbf35 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:48:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:48:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:48:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:48:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:48:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:48:22 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:48:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-09267435-4433-44f0-87f4-42ce6c6dbf35 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:22 devstack sudo[83043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-09267435-4433-44f0-87f4-42ce6c6dbf35 1073741824 Apr 28 05:48:22 devstack sudo[83043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:22 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-ed88623b-9704-4fbc-b5ee-83f5ee75dbff tempest-GroupSnapshotsTest-882628920 None] Create group from source-snapshot-9c8ff16a-978f-443f-89fa-d4336c33d619 completed successfully. Apr 28 05:48:22 devstack sudo[83043]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-09267435-4433-44f0-87f4-42ce6c6dbf35 1073741824" returned: 0 in 0.925s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-09267435-4433-44f0-87f4-42ce6c6dbf35 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:23 devstack sudo[83068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-09267435-4433-44f0-87f4-42ce6c6dbf35 Apr 28 05:48:23 devstack sudo[83068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9fc6b933-d7fe-42e4-aad7-b5faf5c773e5 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "cinder-quobyte-9412b479-d16b-4073-b55e-f0321eb639d8" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:48:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9fc6b933-d7fe-42e4-aad7-b5faf5c773e5 tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-9412b479-d16b-4073-b55e-f0321eb639d8" acquired by "delete_volume" :: waited 0.039s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:48:23 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf2568b-aafe-4362-918b-19a1955d5b8c]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:48:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9fc6b933-d7fe-42e4-aad7-b5faf5c773e5 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9412b479-d16b-4073-b55e-f0321eb639d8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:23 devstack sudo[83073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9412b479-d16b-4073-b55e-f0321eb639d8 Apr 28 05:48:23 devstack sudo[83073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:24 devstack sudo[83068]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-09267435-4433-44f0-87f4-42ce6c6dbf35" returned: 0 in 1.251s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:24 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] <== create_volume: return (2233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:48:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.237s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:24 devstack sudo[83073]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9fc6b933-d7fe-42e4-aad7-b5faf5c773e5 tempest-GroupSnapshotsTest-882628920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9412b479-d16b-4073-b55e-f0321eb639d8" returned: 0 in 0.917s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9fc6b933-d7fe-42e4-aad7-b5faf5c773e5 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9412b479-d16b-4073-b55e-f0321eb639d8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:24 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29c86c4-2946-4cce-bb72-2ba0d7f354be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09267435-4433-44f0-87f4-42ce6c6dbf35', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:24 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe529b51-f1aa-442d-a292-e2671bdc458b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:24 devstack sudo[83093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9412b479-d16b-4073-b55e-f0321eb639d8 Apr 28 05:48:24 devstack sudo[83093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:24 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Volume volume-09267435-4433-44f0-87f4-42ce6c6dbf35 (09267435-4433-44f0-87f4-42ce6c6dbf35): created successfully Apr 28 05:48:24 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe529b51-f1aa-442d-a292-e2671bdc458b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:24 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Flow 'volume_create_manager' (61d33986-186e-4261-8b76-ab8d8959858a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:48:24 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-18269e1e-a88c-4113-8b13-be0ed732669e tempest-VolumesAdminNegativeTest-1906774343 None] Created volume successfully. Apr 28 05:48:24 devstack sudo[83093]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9fc6b933-d7fe-42e4-aad7-b5faf5c773e5 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9412b479-d16b-4073-b55e-f0321eb639d8" returned: 0 in 0.625s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:24 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9fc6b933-d7fe-42e4-aad7-b5faf5c773e5 tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-9412b479-d16b-4073-b55e-f0321eb639d8" released by "delete_volume" :: held 1.625s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:48:24 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-9fc6b933-d7fe-42e4-aad7-b5faf5c773e5 tempest-GroupSnapshotsTest-882628920 None] Created reservations ['469eb552-fe4c-47d2-9a8e-8f498692385e'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:48:25 devstack cinder-volume[81829]: WARNING cinder.quota [None req-9fc6b933-d7fe-42e4-aad7-b5faf5c773e5 tempest-GroupSnapshotsTest-882628920 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1916754056 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1916754056, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:48:25 devstack cinder-volume[81829]: WARNING cinder.quota [None req-9fc6b933-d7fe-42e4-aad7-b5faf5c773e5 tempest-GroupSnapshotsTest-882628920 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1916754056 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1916754056, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:48:25 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-9fc6b933-d7fe-42e4-aad7-b5faf5c773e5 tempest-GroupSnapshotsTest-882628920 None] Created reservations ['c41b8c10-7895-4757-b4ed-9f680bbc6da5', '2382fd02-f097-4b62-b575-f66603ee91d3', '3c384647-58a7-4766-9bcd-168e3a2e0018', '183346ba-f96b-4ce6-b455-984fdf9d261a'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:48:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9fc6b933-d7fe-42e4-aad7-b5faf5c773e5 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:48:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9fc6b933-d7fe-42e4-aad7-b5faf5c773e5 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:48:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-9fc6b933-d7fe-42e4-aad7-b5faf5c773e5 tempest-GroupSnapshotsTest-882628920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:48:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-9fc6b933-d7fe-42e4-aad7-b5faf5c773e5 tempest-GroupSnapshotsTest-882628920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:48:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9fc6b933-d7fe-42e4-aad7-b5faf5c773e5 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9fc6b933-d7fe-42e4-aad7-b5faf5c773e5 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:25 devstack sudo[83096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:48:25 devstack sudo[83096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:25 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-3dbf2fcc-bf7f-4aaa-ad54-5af1799f8d34 tempest-GroupSnapshotsTest-882628920 None] group_snapshot 9c8ff16a-978f-443f-89fa-d4336c33d619: deleting Apr 28 05:48:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3dbf2fcc-bf7f-4aaa-ad54-5af1799f8d34 tempest-GroupSnapshotsTest-882628920 None] group_snapshot 9c8ff16a-978f-443f-89fa-d4336c33d619: deleting {{(pid=81829) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 28 05:48:25 devstack sudo[83096]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9fc6b933-d7fe-42e4-aad7-b5faf5c773e5 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.536s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:25 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-9fc6b933-d7fe-42e4-aad7-b5faf5c773e5 tempest-GroupSnapshotsTest-882628920 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:48:25 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-9fc6b933-d7fe-42e4-aad7-b5faf5c773e5 tempest-GroupSnapshotsTest-882628920 None] Delete group completed successfully. Apr 28 05:48:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3dbf2fcc-bf7f-4aaa-ad54-5af1799f8d34 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "cinder-quobyte-03193659-513d-4921-b057-c820d43dc6c9" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:48:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3dbf2fcc-bf7f-4aaa-ad54-5af1799f8d34 tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-03193659-513d-4921-b057-c820d43dc6c9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:48:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3dbf2fcc-bf7f-4aaa-ad54-5af1799f8d34 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "cinder-quobyte-5fe4cda1-674a-4b46-badc-c8c711c5bd2c" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:48:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3dbf2fcc-bf7f-4aaa-ad54-5af1799f8d34 tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-5fe4cda1-674a-4b46-badc-c8c711c5bd2c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:48:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-3dbf2fcc-bf7f-4aaa-ad54-5af1799f8d34 tempest-GroupSnapshotsTest-882628920 None] Deleting offline snapshot 5fe4cda1-674a-4b46-badc-c8c711c5bd2c of volume 03193659-513d-4921-b057-c820d43dc6c9 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:48:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-3dbf2fcc-bf7f-4aaa-ad54-5af1799f8d34 tempest-GroupSnapshotsTest-882628920 None] snapshot_file for this snap is: volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:48:25 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[12038a1e-f39e-4723-8817-9a2baa441378]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:48:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3dbf2fcc-bf7f-4aaa-ad54-5af1799f8d34 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-438cdd79-0446-4d35-9584-32942480bd5b tempest-VolumesAdminNegativeTest-1906774343 None] Acquiring lock "cinder-09267435-4433-44f0-87f4-42ce6c6dbf35-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:48:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-438cdd79-0446-4d35-9584-32942480bd5b tempest-VolumesAdminNegativeTest-1906774343 None] Lock "cinder-09267435-4433-44f0-87f4-42ce6c6dbf35-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:48:26 devstack sudo[83103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c Apr 28 05:48:26 devstack sudo[83103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-438cdd79-0446-4d35-9584-32942480bd5b tempest-VolumesAdminNegativeTest-1906774343 None] Acquiring lock "cinder-quobyte-09267435-4433-44f0-87f4-42ce6c6dbf35" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:48:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-438cdd79-0446-4d35-9584-32942480bd5b tempest-VolumesAdminNegativeTest-1906774343 None] Lock "cinder-quobyte-09267435-4433-44f0-87f4-42ce6c6dbf35" acquired by "delete_volume" :: waited 0.018s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:48:26 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d896209-4570-4581-8803-d8ded2866cd4]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:48:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-438cdd79-0446-4d35-9584-32942480bd5b tempest-VolumesAdminNegativeTest-1906774343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-09267435-4433-44f0-87f4-42ce6c6dbf35 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:26 devstack sudo[83105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-09267435-4433-44f0-87f4-42ce6c6dbf35 Apr 28 05:48:26 devstack sudo[83105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:26 devstack sudo[83103]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3dbf2fcc-bf7f-4aaa-ad54-5af1799f8d34 tempest-GroupSnapshotsTest-882628920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c" returned: 0 in 0.661s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-3dbf2fcc-bf7f-4aaa-ad54-5af1799f8d34 tempest-GroupSnapshotsTest-882628920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03193659-513d-4921-b057-c820d43dc6c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:48:26 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2eab56-634a-4810-a638-5c45b78f51ae]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:48:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3dbf2fcc-bf7f-4aaa-ad54-5af1799f8d34 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:26 devstack sudo[83113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9 Apr 28 05:48:26 devstack sudo[83113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:26 devstack sudo[83105]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-438cdd79-0446-4d35-9584-32942480bd5b tempest-VolumesAdminNegativeTest-1906774343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-09267435-4433-44f0-87f4-42ce6c6dbf35" returned: 0 in 0.632s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-438cdd79-0446-4d35-9584-32942480bd5b tempest-VolumesAdminNegativeTest-1906774343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-09267435-4433-44f0-87f4-42ce6c6dbf35 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:26 devstack sudo[83118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-09267435-4433-44f0-87f4-42ce6c6dbf35 Apr 28 05:48:26 devstack sudo[83118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:27 devstack sudo[83113]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3dbf2fcc-bf7f-4aaa-ad54-5af1799f8d34 tempest-GroupSnapshotsTest-882628920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9" returned: 0 in 0.543s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3dbf2fcc-bf7f-4aaa-ad54-5af1799f8d34 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:27 devstack sudo[83123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c Apr 28 05:48:27 devstack sudo[83123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:27 devstack sudo[83118]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-438cdd79-0446-4d35-9584-32942480bd5b tempest-VolumesAdminNegativeTest-1906774343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-09267435-4433-44f0-87f4-42ce6c6dbf35" returned: 0 in 0.500s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-438cdd79-0446-4d35-9584-32942480bd5b tempest-VolumesAdminNegativeTest-1906774343 None] Lock "cinder-quobyte-09267435-4433-44f0-87f4-42ce6c6dbf35" released by "delete_volume" :: held 1.179s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:48:27 devstack cinder-volume[81829]: WARNING cinder.quota [None req-438cdd79-0446-4d35-9584-32942480bd5b tempest-VolumesAdminNegativeTest-1906774343 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:48:27 devstack cinder-volume[81829]: WARNING cinder.quota [None req-438cdd79-0446-4d35-9584-32942480bd5b tempest-VolumesAdminNegativeTest-1906774343 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:48:27 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-438cdd79-0446-4d35-9584-32942480bd5b tempest-VolumesAdminNegativeTest-1906774343 None] Created reservations ['44d4199d-d77e-4263-b165-03b73e69014c', '72409a51-a2c8-4a41-88e4-4890d0f5bafe', '1d5963b0-b293-4751-afb8-1e0da0069fb9', '73f3ff90-019b-420e-af62-71a23f86193e'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:48:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-438cdd79-0446-4d35-9584-32942480bd5b tempest-VolumesAdminNegativeTest-1906774343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:48:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-438cdd79-0446-4d35-9584-32942480bd5b tempest-VolumesAdminNegativeTest-1906774343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:48:27 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-438cdd79-0446-4d35-9584-32942480bd5b tempest-VolumesAdminNegativeTest-1906774343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:48:27 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-438cdd79-0446-4d35-9584-32942480bd5b tempest-VolumesAdminNegativeTest-1906774343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:48:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-438cdd79-0446-4d35-9584-32942480bd5b tempest-VolumesAdminNegativeTest-1906774343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-438cdd79-0446-4d35-9584-32942480bd5b tempest-VolumesAdminNegativeTest-1906774343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:27 devstack sudo[83126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:48:27 devstack sudo[83126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:27 devstack sudo[83123]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3dbf2fcc-bf7f-4aaa-ad54-5af1799f8d34 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c" returned: 0 in 0.617s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3dbf2fcc-bf7f-4aaa-ad54-5af1799f8d34 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:27 devstack sudo[83131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c Apr 28 05:48:27 devstack sudo[83131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:27 devstack sudo[83126]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-438cdd79-0446-4d35-9584-32942480bd5b tempest-VolumesAdminNegativeTest-1906774343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.499s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:27 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-438cdd79-0446-4d35-9584-32942480bd5b tempest-VolumesAdminNegativeTest-1906774343 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:48:27 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-438cdd79-0446-4d35-9584-32942480bd5b tempest-VolumesAdminNegativeTest-1906774343 None] Deleted volume successfully. Apr 28 05:48:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-438cdd79-0446-4d35-9584-32942480bd5b tempest-VolumesAdminNegativeTest-1906774343 None] Lock "cinder-09267435-4433-44f0-87f4-42ce6c6dbf35-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:48:28 devstack sudo[83131]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3dbf2fcc-bf7f-4aaa-ad54-5af1799f8d34 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9.5fe4cda1-674a-4b46-badc-c8c711c5bd2c" returned: 0 in 0.509s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3dbf2fcc-bf7f-4aaa-ad54-5af1799f8d34 tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-5fe4cda1-674a-4b46-badc-c8c711c5bd2c" released by "_delete_snapshot" :: held 2.443s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:48:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3dbf2fcc-bf7f-4aaa-ad54-5af1799f8d34 tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-03193659-513d-4921-b057-c820d43dc6c9" released by "delete_snapshot" :: held 2.467s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:48:28 devstack cinder-volume[81829]: WARNING cinder.quota [None req-3dbf2fcc-bf7f-4aaa-ad54-5af1799f8d34 tempest-GroupSnapshotsTest-882628920 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1916754056 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1916754056, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:48:28 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-3dbf2fcc-bf7f-4aaa-ad54-5af1799f8d34 tempest-GroupSnapshotsTest-882628920 None] Created reservations ['86642d40-1652-4a2d-b93f-d03f6d2a2b05', '20ca298c-888f-4e3a-ad1f-c695c3e958da', 'd35fc386-68a1-43b7-a8f3-999368b4daf4', '78463aee-b563-44b3-af5f-7b5e53aa2442'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:48:28 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-3dbf2fcc-bf7f-4aaa-ad54-5af1799f8d34 tempest-GroupSnapshotsTest-882628920 None] group_snapshot 9c8ff16a-978f-443f-89fa-d4336c33d619: deleted successfully Apr 28 05:48:29 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-12b76793-7a5f-43b4-ae1f-be89d6409545 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "cinder-quobyte-03193659-513d-4921-b057-c820d43dc6c9" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:48:29 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-12b76793-7a5f-43b4-ae1f-be89d6409545 tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-03193659-513d-4921-b057-c820d43dc6c9" acquired by "delete_volume" :: waited 0.022s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:48:29 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5b6706-c788-4704-be9c-5940523fc18a]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:48:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-12b76793-7a5f-43b4-ae1f-be89d6409545 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:29 devstack sudo[83136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9 Apr 28 05:48:29 devstack sudo[83136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:29 devstack sudo[83136]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-12b76793-7a5f-43b4-ae1f-be89d6409545 tempest-GroupSnapshotsTest-882628920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9" returned: 0 in 0.667s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-12b76793-7a5f-43b4-ae1f-be89d6409545 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:30 devstack sudo[83169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9 Apr 28 05:48:30 devstack sudo[83169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:30 devstack sudo[83169]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-12b76793-7a5f-43b4-ae1f-be89d6409545 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-03193659-513d-4921-b057-c820d43dc6c9" returned: 0 in 0.705s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-12b76793-7a5f-43b4-ae1f-be89d6409545 tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-03193659-513d-4921-b057-c820d43dc6c9" released by "delete_volume" :: held 1.452s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:48:30 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-12b76793-7a5f-43b4-ae1f-be89d6409545 tempest-GroupSnapshotsTest-882628920 None] Created reservations ['dd943685-4107-4b6e-87f0-0dac7ff2889a'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:48:30 devstack cinder-volume[81829]: WARNING cinder.db.sqlalchemy.api [None req-12b76793-7a5f-43b4-ae1f-be89d6409545 tempest-GroupSnapshotsTest-882628920 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1916754056'] Apr 28 05:48:30 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-12b76793-7a5f-43b4-ae1f-be89d6409545 tempest-GroupSnapshotsTest-882628920 None] Created reservations ['a2ad5590-a612-4c01-b485-af7828fa0841', 'bf6304ce-9fa2-42a6-adf3-9a184f0d5ed3', 'fba5d5c5-e383-4876-9ea8-da81b48bd7a6', '587caab8-ea86-4d8f-8398-10e2dbddaa5b'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:48:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-12b76793-7a5f-43b4-ae1f-be89d6409545 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:48:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-12b76793-7a5f-43b4-ae1f-be89d6409545 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:48:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-12b76793-7a5f-43b4-ae1f-be89d6409545 tempest-GroupSnapshotsTest-882628920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:48:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-12b76793-7a5f-43b4-ae1f-be89d6409545 tempest-GroupSnapshotsTest-882628920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:48:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-12b76793-7a5f-43b4-ae1f-be89d6409545 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-12b76793-7a5f-43b4-ae1f-be89d6409545 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:31 devstack sudo[83179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:48:31 devstack sudo[83179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:31 devstack sudo[83179]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-12b76793-7a5f-43b4-ae1f-be89d6409545 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.886s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:31 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-12b76793-7a5f-43b4-ae1f-be89d6409545 tempest-GroupSnapshotsTest-882628920 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:48:31 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-12b76793-7a5f-43b4-ae1f-be89d6409545 tempest-GroupSnapshotsTest-882628920 None] Delete group completed successfully. Apr 28 05:48:32 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-79c5b8fa-5c27-4938-bc44-6ac4b6616ced tempest-GroupSnapshotsTest-882628920 None] Group tempest-GroupSnapshotsTest-Group-160620435: creating Apr 28 05:48:32 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-79c5b8fa-5c27-4938-bc44-6ac4b6616ced tempest-GroupSnapshotsTest-882628920 None] Group tempest-GroupSnapshotsTest-Group-160620435: created successfully Apr 28 05:48:32 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-79c5b8fa-5c27-4938-bc44-6ac4b6616ced tempest-GroupSnapshotsTest-882628920 None] Create group completed successfully. Apr 28 05:48:33 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:48:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Flow 'volume_create_manager' (bacf5050-b310-4425-8694-53c6d09912f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:48:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c5c31b-0498-4604-b5c9-c9ca158b1752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9c5c31b-0498-4604-b5c9-c9ca158b1752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1328368665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ceadc388-e5ae-476d-8dd7-cfae0fc4c497,host='devstack@QuobyteHD#QuobyteHD',id=6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a157ae164ce43c59f23b818b0d5ae82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:48:34Z,use_quota=True,user_id='cd08c541834b4f77b3df300b97fe4341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de83b7de-0182-49cd-8b02-a8b0e5efb8d2),volume_type_id=de83b7de-0182-49cd-8b02-a8b0e5efb8d2)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (995f7c2f-194b-4c8d-9ed8-12a1f7a12719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (995f7c2f-194b-4c8d-9ed8-12a1f7a12719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ce4fe8-c106-47d2-986e-bdcf239a7959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ce4fe8-c106-47d2-986e-bdcf239a7959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1', 'volume_name': 'volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5379bb-58ca-4068-8d77-79aac7526656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5379bb-58ca-4068-8d77-79aac7526656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c16a833-8bf3-45e0-bbf7-18ba9d73eb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:33 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Volume 6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1', 'volume_size': 1} Apr 28 05:48:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:48:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:48:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ceadc388-e5ae-476d-8dd7-cfae0fc4c497,created_at=2026-04-28T03:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1328368665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ceadc388-e5ae-476d-8dd7-cfae0fc4c497,host='devstack@QuobyteHD#QuobyteHD',id=6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a157ae164ce43c59f23b818b0d5ae82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:48:34Z,use_quota=True,user_id='cd08c541834b4f77b3df300b97fe4341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de83b7de-0182-49cd-8b02-a8b0e5efb8d2),volume_type_id=de83b7de-0182-49cd-8b02-a8b0e5efb8d2)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:48:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Creating volume 6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:48:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:48:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:48:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:48:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:48:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:48:33 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:48:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:33 devstack sudo[83202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1 1073741824 Apr 28 05:48:33 devstack sudo[83202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:34 devstack sudo[83202]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1 1073741824" returned: 0 in 0.791s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:34 devstack sudo[83208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1 Apr 28 05:48:34 devstack sudo[83208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:35 devstack sudo[83208]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1" returned: 0 in 0.720s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:35 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:48:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:35 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c16a833-8bf3-45e0-bbf7-18ba9d73eb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:35 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b41069-2cd2-4a82-95da-c9ab4ca3de6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:35 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Volume volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1 (6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1): created successfully Apr 28 05:48:35 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b41069-2cd2-4a82-95da-c9ab4ca3de6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:35 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Flow 'volume_create_manager' (bacf5050-b310-4425-8694-53c6d09912f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:48:35 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-95580981-0507-4c30-818c-848f7a2eb661 tempest-GroupSnapshotsTest-882628920 None] Created volume successfully. Apr 28 05:48:36 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Flow 'volume_create_manager' (f0247d46-e473-4ce5-9be4-abd74726b59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb576da-1fcb-4f7c-9bed-931a59160301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb576da-1fcb-4f7c-9bed-931a59160301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1127394965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ceadc388-e5ae-476d-8dd7-cfae0fc4c497,host='devstack@QuobyteHD#QuobyteHD',id=e020874a-2d43-43aa-a9ab-1fb89d247647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a157ae164ce43c59f23b818b0d5ae82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:48:37Z,use_quota=True,user_id='cd08c541834b4f77b3df300b97fe4341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de83b7de-0182-49cd-8b02-a8b0e5efb8d2),volume_type_id=de83b7de-0182-49cd-8b02-a8b0e5efb8d2)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42444e87-267d-4c34-b3d9-76ea323a484d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42444e87-267d-4c34-b3d9-76ea323a484d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4860b52-e8eb-4eae-80e7-3af71a573192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4860b52-e8eb-4eae-80e7-3af71a573192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e020874a-2d43-43aa-a9ab-1fb89d247647', 'volume_name': 'volume-e020874a-2d43-43aa-a9ab-1fb89d247647', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ef7ef2-77d1-4f91-85bd-3bbdad411552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ef7ef2-77d1-4f91-85bd-3bbdad411552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c51b64c-84ae-4073-a4d5-137b7deb612a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:37 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Volume e020874a-2d43-43aa-a9ab-1fb89d247647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e020874a-2d43-43aa-a9ab-1fb89d247647', 'volume_size': 1} Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ceadc388-e5ae-476d-8dd7-cfae0fc4c497,created_at=2026-04-28T03:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1127394965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ceadc388-e5ae-476d-8dd7-cfae0fc4c497,host='devstack@QuobyteHD#QuobyteHD',id=e020874a-2d43-43aa-a9ab-1fb89d247647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a157ae164ce43c59f23b818b0d5ae82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:48:37Z,use_quota=True,user_id='cd08c541834b4f77b3df300b97fe4341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de83b7de-0182-49cd-8b02-a8b0e5efb8d2),volume_type_id=de83b7de-0182-49cd-8b02-a8b0e5efb8d2)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Creating volume e020874a-2d43-43aa-a9ab-1fb89d247647 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:48:37 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:37 devstack sudo[83254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647 1073741824 Apr 28 05:48:37 devstack sudo[83254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:37 devstack sudo[83254]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647 1073741824" returned: 0 in 0.756s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:37 devstack sudo[83261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647 Apr 28 05:48:37 devstack sudo[83261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:38 devstack sudo[83261]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647" returned: 0 in 0.592s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:38 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:48:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:38 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c51b64c-84ae-4073-a4d5-137b7deb612a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e020874a-2d43-43aa-a9ab-1fb89d247647', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:38 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2323ba41-4bcc-4469-ac59-ff2dc2bae53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:38 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Volume volume-e020874a-2d43-43aa-a9ab-1fb89d247647 (e020874a-2d43-43aa-a9ab-1fb89d247647): created successfully Apr 28 05:48:38 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2323ba41-4bcc-4469-ac59-ff2dc2bae53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:38 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Flow 'volume_create_manager' (f0247d46-e473-4ce5-9be4-abd74726b59e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:48:38 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-53496e6c-6543-4447-9fba-4beff8154561 tempest-GroupSnapshotsTest-882628920 None] Created volume successfully. Apr 28 05:48:39 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-5af3cf4b-7ed9-4b93-a07f-8aad01a7c3db tempest-GroupSnapshotsTest-882628920 None] Update group completed successfully. Apr 28 05:48:40 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-0549983b-4476-4889-9702-5783a82007ac tempest-GroupSnapshotsTest-882628920 None] Update group completed successfully. Apr 28 05:48:41 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-4d6c28e0-ac16-4a93-bd8c-b0a28f44b860 tempest-GroupSnapshotsTest-882628920 None] Update group completed successfully. Apr 28 05:48:42 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:48:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Flow 'volume_create_manager' (1dd44863-21ae-4004-9fd0-83076a958be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:48:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98fd1277-d88c-449f-8b3a-595188c15c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98fd1277-d88c-449f-8b3a-595188c15c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-228135991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ee4c218b0740e1b644fe650a87a063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:48:42Z,use_quota=True,user_id='10d4da1438fa4363a512f1dbc7b969b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073f6f9f-752c-4349-99d6-33567a1d0179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073f6f9f-752c-4349-99d6-33567a1d0179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d7933a-2802-4d6f-a551-28c94b0f5a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d7933a-2802-4d6f-a551-28c94b0f5a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56', 'volume_name': 'volume-a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c33db453-227b-4595-a33f-cf29436dd2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c33db453-227b-4595-a33f-cf29436dd2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f192f2-2ebe-4743-bc76-d4b46fe0c7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:42 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Volume a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56', 'volume_size': 1} Apr 28 05:48:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:48:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:48:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-228135991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ee4c218b0740e1b644fe650a87a063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:48:42Z,use_quota=True,user_id='10d4da1438fa4363a512f1dbc7b969b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:48:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Creating volume a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:48:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:48:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:48:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:48:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:48:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:48:42 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:48:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:42 devstack sudo[83316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56 1073741824 Apr 28 05:48:42 devstack sudo[83316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:43 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-c8a09ea4-591e-4d09-9baf-288a2271e0a9 tempest-GroupSnapshotsTest-882628920 None] Update group completed successfully. Apr 28 05:48:43 devstack sudo[83316]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56 1073741824" returned: 0 in 0.975s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:43 devstack sudo[83322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56 Apr 28 05:48:43 devstack sudo[83322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:44 devstack sudo[83322]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56" returned: 0 in 0.687s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:48:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f192f2-2ebe-4743-bc76-d4b46fe0c7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d69d185-e2dc-4e53-b5e7-98d3eafcfe95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:44 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Volume volume-a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56 (a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56): created successfully Apr 28 05:48:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d69d185-e2dc-4e53-b5e7-98d3eafcfe95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Flow 'volume_create_manager' (1dd44863-21ae-4004-9fd0-83076a958be1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:48:44 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-dc62298f-2907-424b-9741-5d721fa3fd62 tempest-ServersNegativeTestJSON-1828037125 None] Created volume successfully. Apr 28 05:48:44 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] GroupSnapshot c75d9de8-8fc2-4230-a697-9675d208c421: creating. Apr 28 05:48:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] Group snapshot c75d9de8-8fc2-4230-a697-9675d208c421: creating. {{(pid=81829) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 28 05:48:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:48:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:48:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] Creating offline snapshot 0720a4ea-90bf-4365-b97b-ab9f01f3e9ca of volume e020874a-2d43-43aa-a9ab-1fb89d247647 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:48:44 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6179bf-a70e-4d70-9e5b-f3702c600367]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:48:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:45 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:48:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Flow 'volume_create_manager' (480e31a8-9ab7-4ccf-8146-9f829662ad48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:48:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22df37ab-ba22-4f76-bede-f9fc91e619b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:45 devstack sudo[83325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647 Apr 28 05:48:45 devstack sudo[83325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22df37ab-ba22-4f76-bede-f9fc91e619b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-962218602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97294d72-afd5-4ce3-b14c-b8bc422f8604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db78d840bc3c495891fda49b227a55e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:48:45Z,use_quota=True,user_id='28b38bfc8c41457ab0b184eef0c0e3c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853b779e-6b3b-4d13-8442-41574bd502c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853b779e-6b3b-4d13-8442-41574bd502c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f28cb06-e71d-4bf7-97ce-65ac9b5f1cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f28cb06-e71d-4bf7-97ce-65ac9b5f1cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97294d72-afd5-4ce3-b14c-b8bc422f8604', 'volume_name': 'volume-97294d72-afd5-4ce3-b14c-b8bc422f8604', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37721c36-2758-417f-bf2f-fb41a868edb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37721c36-2758-417f-bf2f-fb41a868edb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c96bd6-bc25-46db-b92b-3cd9941e77f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:45 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Volume 97294d72-afd5-4ce3-b14c-b8bc422f8604: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97294d72-afd5-4ce3-b14c-b8bc422f8604', 'volume_size': 1} Apr 28 05:48:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:48:45 devstack sudo[83325]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647" returned: 0 in 0.833s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.0720a4ea-90bf-4365-b97b-ab9f01f3e9ca 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:45 devstack sudo[83331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.0720a4ea-90bf-4365-b97b-ab9f01f3e9ca 1G Apr 28 05:48:45 devstack sudo[83331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:46 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:48:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Flow 'volume_create_manager' (33a2a3bb-8340-4ad9-b0cc-a10d4291ca86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:48:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34025034-be41-4ab8-b83f-3dbcd83bcb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34025034-be41-4ab8-b83f-3dbcd83bcb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-743474698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3491398c-86ed-48b7-86b4-b2272566eff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ee4c218b0740e1b644fe650a87a063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:48:46Z,use_quota=True,user_id='10d4da1438fa4363a512f1dbc7b969b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d030d110-c25b-4902-8545-7258c585a999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d030d110-c25b-4902-8545-7258c585a999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0aabc06-7305-4261-ab0f-3ac7872b6673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0aabc06-7305-4261-ab0f-3ac7872b6673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3491398c-86ed-48b7-86b4-b2272566eff1', 'volume_name': 'volume-3491398c-86ed-48b7-86b4-b2272566eff1', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00f6a24-be0e-4073-ba1d-b25e399fa6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00f6a24-be0e-4073-ba1d-b25e399fa6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10840300-6856-442f-8930-2953fe71d70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:46 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Volume 3491398c-86ed-48b7-86b4-b2272566eff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3491398c-86ed-48b7-86b4-b2272566eff1', 'volume_size': 1} Apr 28 05:48:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:48:46 devstack sudo[83331]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.0720a4ea-90bf-4365-b97b-ab9f01f3e9ca 1G" returned: 0 in 0.841s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e020874a-2d43-43aa-a9ab-1fb89d247647 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.0720a4ea-90bf-4365-b97b-ab9f01f3e9ca {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:46 devstack sudo[83337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e020874a-2d43-43aa-a9ab-1fb89d247647 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.0720a4ea-90bf-4365-b97b-ab9f01f3e9ca Apr 28 05:48:46 devstack sudo[83337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:47 devstack sudo[83337]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e020874a-2d43-43aa-a9ab-1fb89d247647 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.0720a4ea-90bf-4365-b97b-ab9f01f3e9ca" returned: 0 in 0.691s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:47 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.0720a4ea-90bf-4365-b97b-ab9f01f3e9ca is being set with open permissions: ugo+rw: NotImplementedError Apr 28 05:48:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.0720a4ea-90bf-4365-b97b-ab9f01f3e9ca {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:47 devstack sudo[83342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.0720a4ea-90bf-4365-b97b-ab9f01f3e9ca Apr 28 05:48:47 devstack sudo[83342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:47 devstack sudo[83342]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.0720a4ea-90bf-4365-b97b-ab9f01f3e9ca" returned: 0 in 0.507s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:47 devstack sudo[83345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.info Apr 28 05:48:47 devstack sudo[83345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:48 devstack sudo[83345]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.info" returned: 0 in 0.624s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:48 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 05:48:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:48 devstack sudo[83349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.info Apr 28 05:48:48 devstack sudo[83349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:49 devstack sudo[83349]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.info" returned: 0 in 0.600s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.241s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:48:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:48:49 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] Creating offline snapshot 9e7bbba5-0070-4d6b-94d8-8d5dc3265cad of volume 6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:48:49 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0c81c7-dac9-4214-a512-e4c4a7c133d4]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:48:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:49 devstack sudo[83352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1 Apr 28 05:48:49 devstack sudo[83352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:49 devstack sudo[83352]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1" returned: 0 in 0.694s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.9e7bbba5-0070-4d6b-94d8-8d5dc3265cad 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:49 devstack sudo[83357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.9e7bbba5-0070-4d6b-94d8-8d5dc3265cad 1G Apr 28 05:48:49 devstack sudo[83357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:50 devstack sudo[83357]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.9e7bbba5-0070-4d6b-94d8-8d5dc3265cad 1G" returned: 0 in 0.756s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.9e7bbba5-0070-4d6b-94d8-8d5dc3265cad {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:50 devstack sudo[83363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.9e7bbba5-0070-4d6b-94d8-8d5dc3265cad Apr 28 05:48:50 devstack sudo[83363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:51 devstack sudo[83363]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.9e7bbba5-0070-4d6b-94d8-8d5dc3265cad" returned: 0 in 0.710s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:51 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.9e7bbba5-0070-4d6b-94d8-8d5dc3265cad is being set with open permissions: ugo+rw: NotImplementedError Apr 28 05:48:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.9e7bbba5-0070-4d6b-94d8-8d5dc3265cad {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:51 devstack sudo[83370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.9e7bbba5-0070-4d6b-94d8-8d5dc3265cad Apr 28 05:48:51 devstack sudo[83370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:51 devstack sudo[83370]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.9e7bbba5-0070-4d6b-94d8-8d5dc3265cad" returned: 0 in 0.583s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:51 devstack sudo[83379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.info Apr 28 05:48:51 devstack sudo[83379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:52 devstack sudo[83379]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.info" returned: 0 in 0.632s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:52 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 05:48:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:52 devstack sudo[83382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.info Apr 28 05:48:52 devstack sudo[83382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:53 devstack sudo[83382]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.info" returned: 0 in 0.541s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.076s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.586s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:48:53 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-743474698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3491398c-86ed-48b7-86b4-b2272566eff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ee4c218b0740e1b644fe650a87a063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:48:46Z,use_quota=True,user_id='10d4da1438fa4363a512f1dbc7b969b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:48:53 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Creating volume 3491398c-86ed-48b7-86b4-b2272566eff1 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:48:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:48:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:48:53 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:48:53 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:48:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:53 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:48:53 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:48:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3491398c-86ed-48b7-86b4-b2272566eff1 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:53 devstack sudo[83385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3491398c-86ed-48b7-86b4-b2272566eff1 1073741824 Apr 28 05:48:53 devstack sudo[83385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:53 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-a7e08d98-215d-4a72-9fd1-2e1c3f6477b1 tempest-GroupSnapshotsTest-882628920 None] group_snapshot c75d9de8-8fc2-4230-a697-9675d208c421: created successfully Apr 28 05:48:53 devstack sudo[83385]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3491398c-86ed-48b7-86b4-b2272566eff1 1073741824" returned: 0 in 0.779s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3491398c-86ed-48b7-86b4-b2272566eff1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:53 devstack sudo[83448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3491398c-86ed-48b7-86b4-b2272566eff1 Apr 28 05:48:53 devstack sudo[83448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:54 devstack sudo[83448]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3491398c-86ed-48b7-86b4-b2272566eff1" returned: 0 in 0.502s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.303s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-962218602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97294d72-afd5-4ce3-b14c-b8bc422f8604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db78d840bc3c495891fda49b227a55e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:48:45Z,use_quota=True,user_id='28b38bfc8c41457ab0b184eef0c0e3c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Creating volume 97294d72-afd5-4ce3-b14c-b8bc422f8604 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:48:54 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-97294d72-afd5-4ce3-b14c-b8bc422f8604 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10840300-6856-442f-8930-2953fe71d70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3491398c-86ed-48b7-86b4-b2272566eff1', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:54 devstack sudo[83451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-97294d72-afd5-4ce3-b14c-b8bc422f8604 1073741824 Apr 28 05:48:54 devstack sudo[83451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fadf4422-81eb-483d-bda9-9f31514108aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:54 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Volume volume-3491398c-86ed-48b7-86b4-b2272566eff1 (3491398c-86ed-48b7-86b4-b2272566eff1): created successfully Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fadf4422-81eb-483d-bda9-9f31514108aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Flow 'volume_create_manager' (33a2a3bb-8340-4ad9-b0cc-a10d4291ca86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:48:54 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] group_snapshot c75d9de8-8fc2-4230-a697-9675d208c421: deleting Apr 28 05:48:54 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-208eaf66-cc96-46e4-a193-7d455585f11e tempest-ServersNegativeTestJSON-1828037125 None] Created volume successfully. Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] group_snapshot c75d9de8-8fc2-4230-a697-9675d208c421: deleting {{(pid=81829) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "cinder-quobyte-e020874a-2d43-43aa-a9ab-1fb89d247647" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-e020874a-2d43-43aa-a9ab-1fb89d247647" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "cinder-quobyte-0720a4ea-90bf-4365-b97b-ab9f01f3e9ca" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-0720a4ea-90bf-4365-b97b-ab9f01f3e9ca" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Deleting offline snapshot 0720a4ea-90bf-4365-b97b-ab9f01f3e9ca of volume e020874a-2d43-43aa-a9ab-1fb89d247647 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] snapshot_file for this snap is: volume-e020874a-2d43-43aa-a9ab-1fb89d247647.0720a4ea-90bf-4365-b97b-ab9f01f3e9ca {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a6d1dd-9d12-462f-a4ac-9265dda53f87]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:48:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.0720a4ea-90bf-4365-b97b-ab9f01f3e9ca {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:54 devstack sudo[83453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.0720a4ea-90bf-4365-b97b-ab9f01f3e9ca Apr 28 05:48:54 devstack sudo[83453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:55 devstack sudo[83451]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-97294d72-afd5-4ce3-b14c-b8bc422f8604 1073741824" returned: 0 in 0.863s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:55 devstack sudo[83453]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.0720a4ea-90bf-4365-b97b-ab9f01f3e9ca" returned: 0 in 0.655s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:55 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e020874a-2d43-43aa-a9ab-1fb89d247647(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:48:55 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fc3310-395f-4483-a5d4-638a06ec36ca]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:48:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-97294d72-afd5-4ce3-b14c-b8bc422f8604 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:55 devstack sudo[83462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-97294d72-afd5-4ce3-b14c-b8bc422f8604 Apr 28 05:48:55 devstack sudo[83462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:55 devstack sudo[83461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647 Apr 28 05:48:55 devstack sudo[83461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:55 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6714663d-7e9f-4d76-9400-fdcebe112d1c tempest-ServersNegativeTestJSON-1828037125 None] Acquiring lock "cinder-3491398c-86ed-48b7-86b4-b2272566eff1-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:48:55 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6714663d-7e9f-4d76-9400-fdcebe112d1c tempest-ServersNegativeTestJSON-1828037125 None] Lock "cinder-3491398c-86ed-48b7-86b4-b2272566eff1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:48:55 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6714663d-7e9f-4d76-9400-fdcebe112d1c tempest-ServersNegativeTestJSON-1828037125 None] Acquiring lock "cinder-quobyte-3491398c-86ed-48b7-86b4-b2272566eff1" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:48:55 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6714663d-7e9f-4d76-9400-fdcebe112d1c tempest-ServersNegativeTestJSON-1828037125 None] Lock "cinder-quobyte-3491398c-86ed-48b7-86b4-b2272566eff1" acquired by "delete_volume" :: waited 0.018s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:48:55 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5526cd-56bf-4cf0-ad25-96d76c63a444]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:48:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6714663d-7e9f-4d76-9400-fdcebe112d1c tempest-ServersNegativeTestJSON-1828037125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3491398c-86ed-48b7-86b4-b2272566eff1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:56 devstack sudo[83465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3491398c-86ed-48b7-86b4-b2272566eff1 Apr 28 05:48:56 devstack sudo[83465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:56 devstack sudo[83462]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-97294d72-afd5-4ce3-b14c-b8bc422f8604" returned: 0 in 0.682s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:56 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:48:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:56 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c96bd6-bc25-46db-b92b-3cd9941e77f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97294d72-afd5-4ce3-b14c-b8bc422f8604', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:56 devstack sudo[83461]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:56 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026793ce-cb70-4b4d-832a-80d7c6b3dc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:48:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647" returned: 0 in 0.749s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.0720a4ea-90bf-4365-b97b-ab9f01f3e9ca {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:56 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Volume volume-97294d72-afd5-4ce3-b14c-b8bc422f8604 (97294d72-afd5-4ce3-b14c-b8bc422f8604): created successfully Apr 28 05:48:56 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026793ce-cb70-4b4d-832a-80d7c6b3dc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:48:56 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Flow 'volume_create_manager' (480e31a8-9ab7-4ccf-8146-9f829662ad48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:48:56 devstack sudo[83471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.0720a4ea-90bf-4365-b97b-ab9f01f3e9ca Apr 28 05:48:56 devstack sudo[83471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:56 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-c53056d1-02db-4862-a692-b6513e280d88 tempest-DeleteServersTestJSON-1188481241 None] Created volume successfully. Apr 28 05:48:56 devstack sudo[83465]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6714663d-7e9f-4d76-9400-fdcebe112d1c tempest-ServersNegativeTestJSON-1828037125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3491398c-86ed-48b7-86b4-b2272566eff1" returned: 0 in 0.650s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6714663d-7e9f-4d76-9400-fdcebe112d1c tempest-ServersNegativeTestJSON-1828037125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3491398c-86ed-48b7-86b4-b2272566eff1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:56 devstack sudo[83478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3491398c-86ed-48b7-86b4-b2272566eff1 Apr 28 05:48:56 devstack sudo[83478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:56 devstack sudo[83471]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.0720a4ea-90bf-4365-b97b-ab9f01f3e9ca" returned: 0 in 0.719s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.0720a4ea-90bf-4365-b97b-ab9f01f3e9ca {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:56 devstack sudo[83481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.0720a4ea-90bf-4365-b97b-ab9f01f3e9ca Apr 28 05:48:56 devstack sudo[83481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:57 devstack sudo[83478]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6714663d-7e9f-4d76-9400-fdcebe112d1c tempest-ServersNegativeTestJSON-1828037125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3491398c-86ed-48b7-86b4-b2272566eff1" returned: 0 in 0.648s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6714663d-7e9f-4d76-9400-fdcebe112d1c tempest-ServersNegativeTestJSON-1828037125 None] Lock "cinder-quobyte-3491398c-86ed-48b7-86b4-b2272566eff1" released by "delete_volume" :: held 1.339s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-6714663d-7e9f-4d76-9400-fdcebe112d1c tempest-ServersNegativeTestJSON-1828037125 None] Created reservations ['1e4dee5d-253e-453d-872e-f099cbe4276f', '77a6bb2c-dee1-4add-9ea8-9feb172d5dd0', '183a568d-fb34-4602-8d38-c9093c40fee0', '30873566-1310-4ac9-9141-d435c60af706'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6714663d-7e9f-4d76-9400-fdcebe112d1c tempest-ServersNegativeTestJSON-1828037125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6714663d-7e9f-4d76-9400-fdcebe112d1c tempest-ServersNegativeTestJSON-1828037125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6714663d-7e9f-4d76-9400-fdcebe112d1c tempest-ServersNegativeTestJSON-1828037125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:48:57 devstack sudo[83481]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6714663d-7e9f-4d76-9400-fdcebe112d1c tempest-ServersNegativeTestJSON-1828037125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6714663d-7e9f-4d76-9400-fdcebe112d1c tempest-ServersNegativeTestJSON-1828037125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6714663d-7e9f-4d76-9400-fdcebe112d1c tempest-ServersNegativeTestJSON-1828037125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647.0720a4ea-90bf-4365-b97b-ab9f01f3e9ca" returned: 0 in 0.536s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:57 devstack sudo[83492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:48:57 devstack sudo[83492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-0720a4ea-90bf-4365-b97b-ab9f01f3e9ca" released by "_delete_snapshot" :: held 2.775s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-e020874a-2d43-43aa-a9ab-1fb89d247647" released by "delete_snapshot" :: held 2.800s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "cinder-quobyte-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "cinder-quobyte-9e7bbba5-0070-4d6b-94d8-8d5dc3265cad" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-9e7bbba5-0070-4d6b-94d8-8d5dc3265cad" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Deleting offline snapshot 9e7bbba5-0070-4d6b-94d8-8d5dc3265cad of volume 6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] snapshot_file for this snap is: volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.9e7bbba5-0070-4d6b-94d8-8d5dc3265cad {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[69eeb015-9442-4eb3-beea-d189d8900a4c]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.9e7bbba5-0070-4d6b-94d8-8d5dc3265cad {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:57 devstack sudo[83494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.9e7bbba5-0070-4d6b-94d8-8d5dc3265cad Apr 28 05:48:57 devstack sudo[83494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:57 devstack sudo[83492]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6714663d-7e9f-4d76-9400-fdcebe112d1c tempest-ServersNegativeTestJSON-1828037125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.559s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-6714663d-7e9f-4d76-9400-fdcebe112d1c tempest-ServersNegativeTestJSON-1828037125 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:48:57 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-6714663d-7e9f-4d76-9400-fdcebe112d1c tempest-ServersNegativeTestJSON-1828037125 None] Deleted volume successfully. Apr 28 05:48:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6714663d-7e9f-4d76-9400-fdcebe112d1c tempest-ServersNegativeTestJSON-1828037125 None] Lock "cinder-3491398c-86ed-48b7-86b4-b2272566eff1-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:48:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d072710c-bd3c-466b-9336-21cf953d1c16 tempest-ServersNegativeTestJSON-1828037125 None] Acquiring lock "cinder-a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:48:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d072710c-bd3c-466b-9336-21cf953d1c16 tempest-ServersNegativeTestJSON-1828037125 None] Lock "cinder-a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:48:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d072710c-bd3c-466b-9336-21cf953d1c16 tempest-ServersNegativeTestJSON-1828037125 None] Acquiring lock "cinder-quobyte-a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:48:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d072710c-bd3c-466b-9336-21cf953d1c16 tempest-ServersNegativeTestJSON-1828037125 None] Lock "cinder-quobyte-a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56" acquired by "delete_volume" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:48:58 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[7988ba9a-aeb8-45e0-b7ec-071a89b762e5]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:48:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d072710c-bd3c-466b-9336-21cf953d1c16 tempest-ServersNegativeTestJSON-1828037125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:58 devstack sudo[83494]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.9e7bbba5-0070-4d6b-94d8-8d5dc3265cad" returned: 0 in 0.690s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:48:58 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[b302a390-ba8c-44e1-bd60-cb1e055074e5]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:48:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:58 devstack sudo[83504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56 Apr 28 05:48:58 devstack sudo[83504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:58 devstack sudo[83505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1 Apr 28 05:48:58 devstack sudo[83505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:58 devstack sudo[83505]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1" returned: 0 in 0.613s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.9e7bbba5-0070-4d6b-94d8-8d5dc3265cad {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:58 devstack sudo[83504]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d072710c-bd3c-466b-9336-21cf953d1c16 tempest-ServersNegativeTestJSON-1828037125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56" returned: 0 in 0.675s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d072710c-bd3c-466b-9336-21cf953d1c16 tempest-ServersNegativeTestJSON-1828037125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:58 devstack sudo[83523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.9e7bbba5-0070-4d6b-94d8-8d5dc3265cad Apr 28 05:48:58 devstack sudo[83523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:58 devstack sudo[83524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56 Apr 28 05:48:58 devstack sudo[83524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:59 devstack sudo[83523]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.9e7bbba5-0070-4d6b-94d8-8d5dc3265cad" returned: 0 in 0.766s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.9e7bbba5-0070-4d6b-94d8-8d5dc3265cad {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:48:59 devstack sudo[83531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.9e7bbba5-0070-4d6b-94d8-8d5dc3265cad Apr 28 05:48:59 devstack sudo[83531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:48:59 devstack sudo[83524]: pam_unix(sudo:session): session closed for user root Apr 28 05:48:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d072710c-bd3c-466b-9336-21cf953d1c16 tempest-ServersNegativeTestJSON-1828037125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56" returned: 0 in 0.863s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:48:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d072710c-bd3c-466b-9336-21cf953d1c16 tempest-ServersNegativeTestJSON-1828037125 None] Lock "cinder-quobyte-a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56" released by "delete_volume" :: held 1.595s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:48:59 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-d072710c-bd3c-466b-9336-21cf953d1c16 tempest-ServersNegativeTestJSON-1828037125 None] Created reservations ['24e19fab-2ee3-448c-8ce2-8a282a936f8f', 'ec9abcd1-69fe-4f41-aa72-2b7f27aa8823', 'c47a9f8e-fb10-4415-816e-143454d5e1c2', 'e04e3ca8-5eca-44fe-8910-fb497be2d301'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:49:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d072710c-bd3c-466b-9336-21cf953d1c16 tempest-ServersNegativeTestJSON-1828037125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d072710c-bd3c-466b-9336-21cf953d1c16 tempest-ServersNegativeTestJSON-1828037125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:00 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d072710c-bd3c-466b-9336-21cf953d1c16 tempest-ServersNegativeTestJSON-1828037125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:49:00 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d072710c-bd3c-466b-9336-21cf953d1c16 tempest-ServersNegativeTestJSON-1828037125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:49:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d072710c-bd3c-466b-9336-21cf953d1c16 tempest-ServersNegativeTestJSON-1828037125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d072710c-bd3c-466b-9336-21cf953d1c16 tempest-ServersNegativeTestJSON-1828037125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:00 devstack sudo[83534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:49:00 devstack sudo[83534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:00 devstack sudo[83531]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1.9e7bbba5-0070-4d6b-94d8-8d5dc3265cad" returned: 0 in 0.650s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:00 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-9e7bbba5-0070-4d6b-94d8-8d5dc3265cad" released by "_delete_snapshot" :: held 2.831s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:49:00 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1" released by "delete_snapshot" :: held 2.852s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:49:00 devstack cinder-volume[81829]: WARNING cinder.quota [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-220627126 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-220627126, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:49:00 devstack cinder-volume[81829]: WARNING cinder.quota [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-220627126 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-220627126, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:49:00 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Created reservations ['c10ca310-7229-4fa6-a4b5-88b175d8d897', 'b7474462-8a50-4d78-ad17-8aa9a322349f', 'd466d961-4fa6-4cd1-98d9-251ee86d0ce3', '92cd71f4-06d9-4559-bffa-97ded464244e'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:49:00 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] Created reservations ['6797c9ad-a64a-4336-b91f-57418e924fab', '2857365b-1437-457a-a09b-0460bcea3036', 'b27cf788-68ba-4666-bae2-47999d7e4684', '2d3f9a34-62c5-438d-9b51-c88bdb2cd35b'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:49:00 devstack sudo[83534]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d072710c-bd3c-466b-9336-21cf953d1c16 tempest-ServersNegativeTestJSON-1828037125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.724s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:00 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-d072710c-bd3c-466b-9336-21cf953d1c16 tempest-ServersNegativeTestJSON-1828037125 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:49:00 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-d072710c-bd3c-466b-9336-21cf953d1c16 tempest-ServersNegativeTestJSON-1828037125 None] Deleted volume successfully. Apr 28 05:49:00 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-b9aad74b-c03e-40e5-b3ec-3da36f8b5249 tempest-GroupSnapshotsTest-882628920 None] group_snapshot c75d9de8-8fc2-4230-a697-9675d208c421: deleted successfully Apr 28 05:49:00 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d072710c-bd3c-466b-9336-21cf953d1c16 tempest-ServersNegativeTestJSON-1828037125 None] Lock "cinder-a8f9cc2d-5b47-4c28-875b-cceb3dfaaa56-delete_volume" released by "delete_volume" :: held 2.710s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:49:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "cinder-quobyte-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:49:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1" acquired by "delete_volume" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:49:01 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef86379-41c9-4a26-a723-3bf765e48e0b]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:49:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:01 devstack sudo[83544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1 Apr 28 05:49:02 devstack sudo[83544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:03 devstack sudo[83544]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1" returned: 0 in 1.159s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:03 devstack sudo[83585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1 Apr 28 05:49:03 devstack sudo[83585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:03 devstack cinder-volume[81829]: WARNING py.warnings [req-55eee40f-6eec-430d-83ec-46c895e4c51a req-86b58918-0be3-4f3c-a357-f8c5a75803be tempest-DeleteServersTestJSON-1188481241 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 28 05:49:03 devstack cinder-volume[81829]: .first() Apr 28 05:49:03 devstack cinder-volume[81829]: Apr 28 05:49:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-55eee40f-6eec-430d-83ec-46c895e4c51a req-86b58918-0be3-4f3c-a357-f8c5a75803be tempest-DeleteServersTestJSON-1188481241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-55eee40f-6eec-430d-83ec-46c895e4c51a req-86b58918-0be3-4f3c-a357-f8c5a75803be tempest-DeleteServersTestJSON-1188481241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:03 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5bfeca-318a-45d6-9634-e3aa8661f5a9]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:49:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-55eee40f-6eec-430d-83ec-46c895e4c51a req-86b58918-0be3-4f3c-a357-f8c5a75803be tempest-DeleteServersTestJSON-1188481241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-97294d72-afd5-4ce3-b14c-b8bc422f8604 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:03 devstack sudo[83590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-97294d72-afd5-4ce3-b14c-b8bc422f8604 Apr 28 05:49:03 devstack sudo[83590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:03 devstack sudo[83585]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1" returned: 0 in 0.741s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:03 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-6ebddfdf-1d95-401f-bcda-e68f2b1f4bd1" released by "delete_volume" :: held 2.009s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:49:03 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "cinder-quobyte-e020874a-2d43-43aa-a9ab-1fb89d247647" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:49:03 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-e020874a-2d43-43aa-a9ab-1fb89d247647" acquired by "delete_volume" :: waited 0.020s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:49:03 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c95761-9bb8-43a2-8f20-e6836209d213]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:49:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:03 devstack sudo[83594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647 Apr 28 05:49:03 devstack sudo[83594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:04 devstack sudo[83590]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-55eee40f-6eec-430d-83ec-46c895e4c51a req-86b58918-0be3-4f3c-a357-f8c5a75803be tempest-DeleteServersTestJSON-1188481241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-97294d72-afd5-4ce3-b14c-b8bc422f8604" returned: 0 in 0.747s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-55eee40f-6eec-430d-83ec-46c895e4c51a req-86b58918-0be3-4f3c-a357-f8c5a75803be tempest-DeleteServersTestJSON-1188481241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.779s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-55eee40f-6eec-430d-83ec-46c895e4c51a req-86b58918-0be3-4f3c-a357-f8c5a75803be tempest-DeleteServersTestJSON-1188481241 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381', 'name': 'volume-97294d72-afd5-4ce3-b14c-b8bc422f8604', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5182d3f0-072e-47c0-91dd-59daefc96e76', 'enforce_multipath': True} {{(pid=81829) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 28 05:49:04 devstack cinder-volume[81829]: INFO cinder.volume.manager [req-55eee40f-6eec-430d-83ec-46c895e4c51a req-86b58918-0be3-4f3c-a357-f8c5a75803be tempest-DeleteServersTestJSON-1188481241 None] attachment_update completed successfully. Apr 28 05:49:04 devstack sudo[83594]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647" returned: 0 in 0.880s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:04 devstack sudo[83604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647 Apr 28 05:49:04 devstack sudo[83604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:05 devstack sudo[83604]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e020874a-2d43-43aa-a9ab-1fb89d247647" returned: 0 in 0.728s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-e020874a-2d43-43aa-a9ab-1fb89d247647" released by "delete_volume" :: held 1.685s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:49:05 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] Created reservations ['a34012a1-7d54-4bdd-bb81-660d02ae2603'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:49:05 devstack cinder-volume[81829]: WARNING cinder.quota [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-220627126 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-220627126, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:49:05 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] Created reservations ['d7f2a8d6-0699-4f5f-a33d-fb00a61b6c18', 'b577228f-5c86-412b-b55b-80f51d9d5406', 'd52f81bd-bfa2-4291-ac3d-0567d817d4dc', '648ee9e2-5fa6-4d24-bc76-c77521f20cd6'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:49:05 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] Created reservations ['9157df10-3f4f-47e9-93ec-b748b5a49a10', '756dfbdf-8afc-4375-b63c-5fb5b9f75c2c', '34b8dece-2b85-4895-b5b6-f70de9a491c5', '98eee152-e15f-409f-91c6-6454e1656b28'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:49:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:49:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:49:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:05 devstack sudo[83676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:49:05 devstack sudo[83676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:06 devstack sudo[83676]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.654s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:06 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:49:06 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-ee5543b4-c230-4667-84c8-5fa928b7e495 tempest-GroupSnapshotsTest-882628920 None] Delete group completed successfully. Apr 28 05:49:06 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-0c961c79-c59a-45c4-9dde-ff520f9a58bd tempest-GroupSnapshotsTest-882628920 None] Group tempest-GroupSnapshotsTest-Group-1847983870: creating Apr 28 05:49:06 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-0c961c79-c59a-45c4-9dde-ff520f9a58bd tempest-GroupSnapshotsTest-882628920 None] Group tempest-GroupSnapshotsTest-Group-1847983870: created successfully Apr 28 05:49:06 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-0c961c79-c59a-45c4-9dde-ff520f9a58bd tempest-GroupSnapshotsTest-882628920 None] Create group completed successfully. Apr 28 05:49:06 devstack cinder-volume[81829]: DEBUG oslo_service.periodic_task [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81829) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 05:49:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:49:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:49:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:06 devstack sudo[84002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:49:06 devstack sudo[84002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:07 devstack sudo[84002]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.482s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:07 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:49:08 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:49:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Flow 'volume_create_manager' (712e0881-9274-4f82-ab5b-4183545e5d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:49:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ce891f-40f4-4e3e-a702-93d189f4a139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ce891f-40f4-4e3e-a702-93d189f4a139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-685773951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=094197b9-3b9f-485e-9df1-76a55903eedf,host='devstack@QuobyteHD#QuobyteHD',id=dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a157ae164ce43c59f23b818b0d5ae82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:49:08Z,use_quota=True,user_id='cd08c541834b4f77b3df300b97fe4341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cdfb7a-287e-43a0-845c-bd7ca794931a),volume_type_id=00cdfb7a-287e-43a0-845c-bd7ca794931a)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a18436-11cf-4557-83e9-30ef0aa7a812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a18436-11cf-4557-83e9-30ef0aa7a812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d235007c-fd1f-4378-8420-acdd9e2a12c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d235007c-fd1f-4378-8420-acdd9e2a12c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026', 'volume_name': 'volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b657f0f-a3b2-4254-aa9e-8aba71efc0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b657f0f-a3b2-4254-aa9e-8aba71efc0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc736b61-cdd2-43b3-9734-afbefc017817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:08 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Volume dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026', 'volume_size': 1} Apr 28 05:49:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=094197b9-3b9f-485e-9df1-76a55903eedf,created_at=2026-04-28T03:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-685773951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=094197b9-3b9f-485e-9df1-76a55903eedf,host='devstack@QuobyteHD#QuobyteHD',id=dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a157ae164ce43c59f23b818b0d5ae82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:49:08Z,use_quota=True,user_id='cd08c541834b4f77b3df300b97fe4341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cdfb7a-287e-43a0-845c-bd7ca794931a),volume_type_id=00cdfb7a-287e-43a0-845c-bd7ca794931a)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:49:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Creating volume dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:49:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:49:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:49:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:49:08 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:49:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:08 devstack sudo[84007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026 1073741824 Apr 28 05:49:08 devstack sudo[84007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:09 devstack sudo[84007]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026 1073741824" returned: 0 in 0.783s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:09 devstack sudo[84014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026 Apr 28 05:49:09 devstack sudo[84014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:09 devstack sudo[84014]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026" returned: 0 in 0.538s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:49:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc736b61-cdd2-43b3-9734-afbefc017817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc91cbc-a44c-4744-b79e-79dd500f4d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:09 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Volume volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026 (dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026): created successfully Apr 28 05:49:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc91cbc-a44c-4744-b79e-79dd500f4d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Flow 'volume_create_manager' (712e0881-9274-4f82-ab5b-4183545e5d6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:49:09 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-e4eb3578-3ee3-4845-93e1-d7b291916eef tempest-GroupSnapshotsTest-882628920 None] Created volume successfully. Apr 28 05:49:10 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-22e01de9-5d5c-444d-857a-014e0a5ac2f6 tempest-GroupSnapshotsTest-882628920 None] GroupSnapshot f66cf19f-5a05-4c3f-bfe2-5a6c9ecd0811: creating. Apr 28 05:49:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-22e01de9-5d5c-444d-857a-014e0a5ac2f6 tempest-GroupSnapshotsTest-882628920 None] Group snapshot f66cf19f-5a05-4c3f-bfe2-5a6c9ecd0811: creating. {{(pid=81829) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 28 05:49:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-22e01de9-5d5c-444d-857a-014e0a5ac2f6 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-22e01de9-5d5c-444d-857a-014e0a5ac2f6 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:10 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-22e01de9-5d5c-444d-857a-014e0a5ac2f6 tempest-GroupSnapshotsTest-882628920 None] Creating offline snapshot 41bcc92c-d890-4d82-843a-8f950d8be604 of volume dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:49:10 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[8109812b-675a-4e31-a2a6-5379c44aa70a]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:49:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-22e01de9-5d5c-444d-857a-014e0a5ac2f6 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:10 devstack sudo[84020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026 Apr 28 05:49:10 devstack sudo[84020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:11 devstack sudo[84020]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-22e01de9-5d5c-444d-857a-014e0a5ac2f6 tempest-GroupSnapshotsTest-882628920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026" returned: 0 in 0.720s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-22e01de9-5d5c-444d-857a-014e0a5ac2f6 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.41bcc92c-d890-4d82-843a-8f950d8be604 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:11 devstack sudo[84039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.41bcc92c-d890-4d82-843a-8f950d8be604 1G Apr 28 05:49:11 devstack sudo[84039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:12 devstack sudo[84039]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-22e01de9-5d5c-444d-857a-014e0a5ac2f6 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.41bcc92c-d890-4d82-843a-8f950d8be604 1G" returned: 0 in 0.748s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-22e01de9-5d5c-444d-857a-014e0a5ac2f6 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.41bcc92c-d890-4d82-843a-8f950d8be604 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:12 devstack sudo[84088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.41bcc92c-d890-4d82-843a-8f950d8be604 Apr 28 05:49:12 devstack sudo[84088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:13 devstack sudo[84088]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-22e01de9-5d5c-444d-857a-014e0a5ac2f6 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.41bcc92c-d890-4d82-843a-8f950d8be604" returned: 0 in 0.682s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:13 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-22e01de9-5d5c-444d-857a-014e0a5ac2f6 tempest-GroupSnapshotsTest-882628920 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.41bcc92c-d890-4d82-843a-8f950d8be604 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 05:49:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-22e01de9-5d5c-444d-857a-014e0a5ac2f6 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.41bcc92c-d890-4d82-843a-8f950d8be604 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:13 devstack sudo[84096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.41bcc92c-d890-4d82-843a-8f950d8be604 Apr 28 05:49:13 devstack sudo[84096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:13 devstack sudo[84096]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-22e01de9-5d5c-444d-857a-014e0a5ac2f6 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.41bcc92c-d890-4d82-843a-8f950d8be604" returned: 0 in 0.745s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-22e01de9-5d5c-444d-857a-014e0a5ac2f6 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:13 devstack sudo[84112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.info Apr 28 05:49:13 devstack sudo[84112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:14 devstack sudo[84112]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-22e01de9-5d5c-444d-857a-014e0a5ac2f6 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.info" returned: 0 in 0.684s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:14 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-22e01de9-5d5c-444d-857a-014e0a5ac2f6 tempest-GroupSnapshotsTest-882628920 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 05:49:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-22e01de9-5d5c-444d-857a-014e0a5ac2f6 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:14 devstack sudo[84122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.info Apr 28 05:49:14 devstack sudo[84122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:14 devstack cinder-volume[81829]: INFO cinder.volume.manager [req-e8b2eafa-be2d-4249-b705-b32fed5f6789 req-5b967973-657c-4242-b6a8-8ff58b8fa00a tempest-DeleteServersTestJSON-1188481241 None] Terminate volume connection completed successfully. Apr 28 05:49:14 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-e8b2eafa-be2d-4249-b705-b32fed5f6789 req-5b967973-657c-4242-b6a8-8ff58b8fa00a tempest-DeleteServersTestJSON-1188481241 None] Deleting attachment 5182d3f0-072e-47c0-91dd-59daefc96e76. {{(pid=81829) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 28 05:49:15 devstack sudo[84122]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-22e01de9-5d5c-444d-857a-014e0a5ac2f6 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.info" returned: 0 in 0.598s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-22e01de9-5d5c-444d-857a-014e0a5ac2f6 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.295s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:15 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-22e01de9-5d5c-444d-857a-014e0a5ac2f6 tempest-GroupSnapshotsTest-882628920 None] group_snapshot f66cf19f-5a05-4c3f-bfe2-5a6c9ecd0811: created successfully Apr 28 05:49:16 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] group_snapshot f66cf19f-5a05-4c3f-bfe2-5a6c9ecd0811: deleting Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] group_snapshot f66cf19f-5a05-4c3f-bfe2-5a6c9ecd0811: deleting {{(pid=81829) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "cinder-quobyte-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "cinder-quobyte-41bcc92c-d890-4d82-843a-8f950d8be604" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-41bcc92c-d890-4d82-843a-8f950d8be604" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] Deleting offline snapshot 41bcc92c-d890-4d82-843a-8f950d8be604 of volume dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] snapshot_file for this snap is: volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.41bcc92c-d890-4d82-843a-8f950d8be604 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdb9f6e-203a-41ac-bd0a-0b689f397e5d]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.41bcc92c-d890-4d82-843a-8f950d8be604 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:16 devstack sudo[84126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.41bcc92c-d890-4d82-843a-8f950d8be604 Apr 28 05:49:16 devstack sudo[84126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Flow 'volume_create_manager' (87148e99-1e5c-49e1-b834-f187167a9500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca8371f8-7ad1-44b0-8ad9-cd8623a60edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca8371f8-7ad1-44b0-8ad9-cd8623a60edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1813814288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee91e1a-cd72-4d2e-bec2-3a27a061150f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ecbdc1d3e1af4bd68f0000f1c824a6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:49:17Z,use_quota=True,user_id='5b67715fa9b849998623ca5c482b5e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e6e7bb-f190-4ee7-aa59-a87a3267b8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e6e7bb-f190-4ee7-aa59-a87a3267b8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f5a776-d5b0-4e84-8694-3128ef17caa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f5a776-d5b0-4e84-8694-3128ef17caa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bee91e1a-cd72-4d2e-bec2-3a27a061150f', 'volume_name': 'volume-bee91e1a-cd72-4d2e-bec2-3a27a061150f', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e615f747-b28e-4e24-b321-026145428fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e615f747-b28e-4e24-b321-026145428fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e1f438-8ed4-4d04-9ea0-ad4c3c1a5e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:16 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Volume bee91e1a-cd72-4d2e-bec2-3a27a061150f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bee91e1a-cd72-4d2e-bec2-3a27a061150f', 'volume_size': 1} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1813814288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee91e1a-cd72-4d2e-bec2-3a27a061150f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ecbdc1d3e1af4bd68f0000f1c824a6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:49:17Z,use_quota=True,user_id='5b67715fa9b849998623ca5c482b5e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Creating volume bee91e1a-cd72-4d2e-bec2-3a27a061150f {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:49:16 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:49:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-bee91e1a-cd72-4d2e-bec2-3a27a061150f 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:16 devstack sudo[84128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-bee91e1a-cd72-4d2e-bec2-3a27a061150f 1073741824 Apr 28 05:49:16 devstack sudo[84128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:17 devstack sudo[84126]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.41bcc92c-d890-4d82-843a-8f950d8be604" returned: 0 in 0.602s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:17 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:49:17 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f4fb5e-7946-438c-8a22-36fdd4988e4c]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:49:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:17 devstack sudo[84136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026 Apr 28 05:49:17 devstack sudo[84136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:17 devstack sudo[84128]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-bee91e1a-cd72-4d2e-bec2-3a27a061150f 1073741824" returned: 0 in 0.677s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-bee91e1a-cd72-4d2e-bec2-3a27a061150f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:17 devstack sudo[84138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-bee91e1a-cd72-4d2e-bec2-3a27a061150f Apr 28 05:49:17 devstack sudo[84138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:17 devstack sudo[84136]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026" returned: 0 in 0.686s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.41bcc92c-d890-4d82-843a-8f950d8be604 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:17 devstack sudo[84180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.41bcc92c-d890-4d82-843a-8f950d8be604 Apr 28 05:49:17 devstack sudo[84180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:18 devstack sudo[84138]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-bee91e1a-cd72-4d2e-bec2-3a27a061150f" returned: 0 in 0.558s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:49:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e1f438-8ed4-4d04-9ea0-ad4c3c1a5e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bee91e1a-cd72-4d2e-bec2-3a27a061150f', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1968c7e6-130d-4509-95cc-8191a42c8490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:18 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Volume volume-bee91e1a-cd72-4d2e-bec2-3a27a061150f (bee91e1a-cd72-4d2e-bec2-3a27a061150f): created successfully Apr 28 05:49:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1968c7e6-130d-4509-95cc-8191a42c8490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Flow 'volume_create_manager' (87148e99-1e5c-49e1-b834-f187167a9500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:49:18 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-597d6391-f88e-4df6-973d-88b0f4c87af4 tempest-VolumesTestJSON-1518774991 None] Created volume successfully. Apr 28 05:49:18 devstack sudo[84180]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.41bcc92c-d890-4d82-843a-8f950d8be604" returned: 0 in 0.602s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.41bcc92c-d890-4d82-843a-8f950d8be604 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:18 devstack sudo[84188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.41bcc92c-d890-4d82-843a-8f950d8be604 Apr 28 05:49:18 devstack sudo[84188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:18 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9cb369e6-a38a-419c-a384-9ac9fd9b4660 tempest-DeleteServersTestJSON-1188481241 None] Acquiring lock "cinder-97294d72-afd5-4ce3-b14c-b8bc422f8604-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:49:18 devstack sudo[84188]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026.41bcc92c-d890-4d82-843a-8f950d8be604" returned: 0 in 0.527s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9cb369e6-a38a-419c-a384-9ac9fd9b4660 tempest-DeleteServersTestJSON-1188481241 None] Lock "cinder-97294d72-afd5-4ce3-b14c-b8bc422f8604-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-41bcc92c-d890-4d82-843a-8f950d8be604" released by "_delete_snapshot" :: held 2.540s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026" released by "delete_snapshot" :: held 2.567s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9cb369e6-a38a-419c-a384-9ac9fd9b4660 tempest-DeleteServersTestJSON-1188481241 None] Acquiring lock "cinder-quobyte-97294d72-afd5-4ce3-b14c-b8bc422f8604" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9cb369e6-a38a-419c-a384-9ac9fd9b4660 tempest-DeleteServersTestJSON-1188481241 None] Lock "cinder-quobyte-97294d72-afd5-4ce3-b14c-b8bc422f8604" acquired by "delete_volume" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[60be910e-fd0c-4048-bf57-792072b08488]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9cb369e6-a38a-419c-a384-9ac9fd9b4660 tempest-DeleteServersTestJSON-1188481241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-97294d72-afd5-4ce3-b14c-b8bc422f8604 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:UPDATE=124,cinder:SELECT=130,cinder:INSERT=30,cinder:DELETE=7 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:49:19 devstack cinder-volume[81829]: WARNING cinder.quota [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-525494761 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-525494761, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:49:19 devstack cinder-volume[81829]: WARNING cinder.quota [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-525494761 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-525494761, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] Created reservations ['cdb58984-a6e2-4fd8-af57-787bded43ef4', '32b0ef41-fdd0-4447-af4b-d3a1af560816', '28085bb6-1613-47c8-9980-be4cdcab13b6', '7c517bc6-8e24-42d3-89d5-1cd28db3ba89'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:49:19 devstack sudo[84191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-97294d72-afd5-4ce3-b14c-b8bc422f8604 Apr 28 05:49:19 devstack sudo[84191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:19 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-11c105e3-ac61-48bc-bcdf-a9427a5ed5ab tempest-GroupSnapshotsTest-882628920 None] group_snapshot f66cf19f-5a05-4c3f-bfe2-5a6c9ecd0811: deleted successfully Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Flow 'volume_create_manager' (4831ce9b-dbbd-43dd-a459-2202bf28b40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88cef01e-5823-4e53-82ed-cf2e11661c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:UPDATE=129,cinder:SELECT=117,cinder:INSERT=28,cinder:DELETE=4 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88cef01e-5823-4e53-82ed-cf2e11661c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2060870867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3073cd-1257-4c05-99f9-75a04822fbb8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ecbdc1d3e1af4bd68f0000f1c824a6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:49:19Z,use_quota=True,user_id='5b67715fa9b849998623ca5c482b5e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4604b061-bcb4-4b8f-8cad-c8a54e7e6fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4604b061-bcb4-4b8f-8cad-c8a54e7e6fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88521cfe-f1fd-4a0d-adbc-efc26646ba2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88521cfe-f1fd-4a0d-adbc-efc26646ba2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee3073cd-1257-4c05-99f9-75a04822fbb8', 'volume_name': 'volume-ee3073cd-1257-4c05-99f9-75a04822fbb8', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b14f6644-8ba0-4a24-b082-61fd1c0b21e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b14f6644-8ba0-4a24-b082-61fd1c0b21e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d40f66a-6785-47f9-b2d6-bb189987205e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:19 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Volume ee3073cd-1257-4c05-99f9-75a04822fbb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee3073cd-1257-4c05-99f9-75a04822fbb8', 'volume_size': 1} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2060870867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3073cd-1257-4c05-99f9-75a04822fbb8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ecbdc1d3e1af4bd68f0000f1c824a6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:49:19Z,use_quota=True,user_id='5b67715fa9b849998623ca5c482b5e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Creating volume ee3073cd-1257-4c05-99f9-75a04822fbb8 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:49:19 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee3073cd-1257-4c05-99f9-75a04822fbb8 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:19 devstack sudo[84196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee3073cd-1257-4c05-99f9-75a04822fbb8 1073741824 Apr 28 05:49:19 devstack sudo[84196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:19 devstack sudo[84191]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9cb369e6-a38a-419c-a384-9ac9fd9b4660 tempest-DeleteServersTestJSON-1188481241 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-97294d72-afd5-4ce3-b14c-b8bc422f8604" returned: 0 in 0.629s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9cb369e6-a38a-419c-a384-9ac9fd9b4660 tempest-DeleteServersTestJSON-1188481241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-97294d72-afd5-4ce3-b14c-b8bc422f8604 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:19 devstack sudo[84204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-97294d72-afd5-4ce3-b14c-b8bc422f8604 Apr 28 05:49:19 devstack sudo[84204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:20 devstack sudo[84196]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee3073cd-1257-4c05-99f9-75a04822fbb8 1073741824" returned: 0 in 0.699s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee3073cd-1257-4c05-99f9-75a04822fbb8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:20 devstack sudo[84213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee3073cd-1257-4c05-99f9-75a04822fbb8 Apr 28 05:49:20 devstack sudo[84213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cb78c088-c82e-4a21-b3a1-9d326a13da29 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "cinder-quobyte-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:49:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cb78c088-c82e-4a21-b3a1-9d326a13da29 tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026" acquired by "delete_volume" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:49:20 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[5233226a-a84a-4f05-b510-0c2ccfb925da]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:49:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cb78c088-c82e-4a21-b3a1-9d326a13da29 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:20 devstack sudo[84220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026 Apr 28 05:49:20 devstack sudo[84220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:20 devstack sudo[84204]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9cb369e6-a38a-419c-a384-9ac9fd9b4660 tempest-DeleteServersTestJSON-1188481241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-97294d72-afd5-4ce3-b14c-b8bc422f8604" returned: 0 in 0.614s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9cb369e6-a38a-419c-a384-9ac9fd9b4660 tempest-DeleteServersTestJSON-1188481241 None] Lock "cinder-quobyte-97294d72-afd5-4ce3-b14c-b8bc422f8604" released by "delete_volume" :: held 1.287s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:49:20 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-9cb369e6-a38a-419c-a384-9ac9fd9b4660 tempest-DeleteServersTestJSON-1188481241 None] Created reservations ['65905c9c-09bf-4032-8d46-be882ec7c7a7', '96a25cac-24f8-43cd-a70c-84e348be75b3', 'be41cee1-3517-4046-9ab3-7585afb10257', '7197c933-9a5f-485a-a73c-79428e15483a'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:49:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9cb369e6-a38a-419c-a384-9ac9fd9b4660 tempest-DeleteServersTestJSON-1188481241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9cb369e6-a38a-419c-a384-9ac9fd9b4660 tempest-DeleteServersTestJSON-1188481241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-9cb369e6-a38a-419c-a384-9ac9fd9b4660 tempest-DeleteServersTestJSON-1188481241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:49:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-9cb369e6-a38a-419c-a384-9ac9fd9b4660 tempest-DeleteServersTestJSON-1188481241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:49:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9cb369e6-a38a-419c-a384-9ac9fd9b4660 tempest-DeleteServersTestJSON-1188481241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9cb369e6-a38a-419c-a384-9ac9fd9b4660 tempest-DeleteServersTestJSON-1188481241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:20 devstack sudo[84238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:49:20 devstack sudo[84238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:21 devstack sudo[84213]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee3073cd-1257-4c05-99f9-75a04822fbb8" returned: 0 in 0.880s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:49:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d40f66a-6785-47f9-b2d6-bb189987205e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3073cd-1257-4c05-99f9-75a04822fbb8', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d18529-2073-45c4-ba6d-d8178e23187e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:21 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Volume volume-ee3073cd-1257-4c05-99f9-75a04822fbb8 (ee3073cd-1257-4c05-99f9-75a04822fbb8): created successfully Apr 28 05:49:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d18529-2073-45c4-ba6d-d8178e23187e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Flow 'volume_create_manager' (4831ce9b-dbbd-43dd-a459-2202bf28b40c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:49:21 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-964b30d9-da34-401c-acff-21b90c4e325f tempest-VolumesTestJSON-1518774991 None] Created volume successfully. Apr 28 05:49:21 devstack sudo[84238]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9cb369e6-a38a-419c-a384-9ac9fd9b4660 tempest-DeleteServersTestJSON-1188481241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.731s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:21 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-9cb369e6-a38a-419c-a384-9ac9fd9b4660 tempest-DeleteServersTestJSON-1188481241 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:49:21 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-9cb369e6-a38a-419c-a384-9ac9fd9b4660 tempest-DeleteServersTestJSON-1188481241 None] Deleted volume successfully. Apr 28 05:49:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9cb369e6-a38a-419c-a384-9ac9fd9b4660 tempest-DeleteServersTestJSON-1188481241 None] Lock "cinder-97294d72-afd5-4ce3-b14c-b8bc422f8604-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:49:21 devstack sudo[84220]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cb78c088-c82e-4a21-b3a1-9d326a13da29 tempest-GroupSnapshotsTest-882628920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026" returned: 0 in 1.153s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cb78c088-c82e-4a21-b3a1-9d326a13da29 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:21 devstack sudo[84261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026 Apr 28 05:49:21 devstack sudo[84261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Flow 'volume_create_manager' (8bc01442-555a-444e-af8f-dbbd15b4e883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace99ea5-57d2-49ef-9388-b97cd5e37832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:22 devstack sudo[84261]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace99ea5-57d2-49ef-9388-b97cd5e37832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-266211003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee2ffd0d-f27f-421e-bdd7-beba4b080abe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ecbdc1d3e1af4bd68f0000f1c824a6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:49:22Z,use_quota=True,user_id='5b67715fa9b849998623ca5c482b5e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd8d4ca-a559-49b9-ad2a-4781b6098778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd8d4ca-a559-49b9-ad2a-4781b6098778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa92a124-378f-419d-9894-33f937e829bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa92a124-378f-419d-9894-33f937e829bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee2ffd0d-f27f-421e-bdd7-beba4b080abe', 'volume_name': 'volume-ee2ffd0d-f27f-421e-bdd7-beba4b080abe', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52b1d5ca-94f3-4d07-a8bf-06d635f703e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52b1d5ca-94f3-4d07-a8bf-06d635f703e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778e4dc9-a2d9-4bd1-8320-24085a47bfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:22 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Volume ee2ffd0d-f27f-421e-bdd7-beba4b080abe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee2ffd0d-f27f-421e-bdd7-beba4b080abe', 'volume_size': 1} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-266211003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee2ffd0d-f27f-421e-bdd7-beba4b080abe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ecbdc1d3e1af4bd68f0000f1c824a6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:49:22Z,use_quota=True,user_id='5b67715fa9b849998623ca5c482b5e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Creating volume ee2ffd0d-f27f-421e-bdd7-beba4b080abe {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:49:22 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee2ffd0d-f27f-421e-bdd7-beba4b080abe 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cb78c088-c82e-4a21-b3a1-9d326a13da29 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026" returned: 0 in 0.781s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cb78c088-c82e-4a21-b3a1-9d326a13da29 tempest-GroupSnapshotsTest-882628920 None] Lock "cinder-quobyte-dbf8cc5a-7fd4-444c-b9ef-e4d9e503f026" released by "delete_volume" :: held 2.023s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:49:22 devstack sudo[84265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee2ffd0d-f27f-421e-bdd7-beba4b080abe 1073741824 Apr 28 05:49:22 devstack sudo[84265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-cb78c088-c82e-4a21-b3a1-9d326a13da29 tempest-GroupSnapshotsTest-882628920 None] Created reservations ['82db0566-7937-4068-90da-2670af810fe3'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:49:22 devstack cinder-volume[81829]: WARNING cinder.quota [None req-cb78c088-c82e-4a21-b3a1-9d326a13da29 tempest-GroupSnapshotsTest-882628920 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-525494761 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-525494761, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-cb78c088-c82e-4a21-b3a1-9d326a13da29 tempest-GroupSnapshotsTest-882628920 None] Created reservations ['714ed58f-cf9d-4e33-813f-5d35df1d86e9', '1fcd6077-e502-4a29-aace-b75e660fd9b6', '250dad4c-2887-4b04-a9ad-4050b47a20c1', '2e1e199a-04e3-4c80-a43a-2490a7202204'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cb78c088-c82e-4a21-b3a1-9d326a13da29 tempest-GroupSnapshotsTest-882628920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cb78c088-c82e-4a21-b3a1-9d326a13da29 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cb78c088-c82e-4a21-b3a1-9d326a13da29 tempest-GroupSnapshotsTest-882628920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cb78c088-c82e-4a21-b3a1-9d326a13da29 tempest-GroupSnapshotsTest-882628920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cb78c088-c82e-4a21-b3a1-9d326a13da29 tempest-GroupSnapshotsTest-882628920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cb78c088-c82e-4a21-b3a1-9d326a13da29 tempest-GroupSnapshotsTest-882628920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:22 devstack sudo[84267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:49:22 devstack sudo[84267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:23 devstack sudo[84265]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee2ffd0d-f27f-421e-bdd7-beba4b080abe 1073741824" returned: 0 in 1.506s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee2ffd0d-f27f-421e-bdd7-beba4b080abe {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:23 devstack sudo[84275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee2ffd0d-f27f-421e-bdd7-beba4b080abe Apr 28 05:49:23 devstack sudo[84275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:23 devstack sudo[84267]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cb78c088-c82e-4a21-b3a1-9d326a13da29 tempest-GroupSnapshotsTest-882628920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 1.210s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:23 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-cb78c088-c82e-4a21-b3a1-9d326a13da29 tempest-GroupSnapshotsTest-882628920 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:49:23 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-cb78c088-c82e-4a21-b3a1-9d326a13da29 tempest-GroupSnapshotsTest-882628920 None] Delete group completed successfully. Apr 28 05:49:24 devstack sudo[84275]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee2ffd0d-f27f-421e-bdd7-beba4b080abe" returned: 0 in 0.850s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:24 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] <== create_volume: return (2436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:49:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.440s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:24 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778e4dc9-a2d9-4bd1-8320-24085a47bfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee2ffd0d-f27f-421e-bdd7-beba4b080abe', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:24 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e3a9f96-83e8-4a31-8969-8afe4393baf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:24 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Volume volume-ee2ffd0d-f27f-421e-bdd7-beba4b080abe (ee2ffd0d-f27f-421e-bdd7-beba4b080abe): created successfully Apr 28 05:49:24 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e3a9f96-83e8-4a31-8969-8afe4393baf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:24 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Flow 'volume_create_manager' (8bc01442-555a-444e-af8f-dbbd15b4e883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:49:24 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-6e567e79-71ef-4c49-8917-40b3e971b4ea tempest-VolumesTestJSON-1518774991 None] Created volume successfully. Apr 28 05:49:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-623f7352-343c-4630-a469-88111600d90b tempest-VolumesTestJSON-1518774991 None] Acquiring lock "cinder-ee2ffd0d-f27f-421e-bdd7-beba4b080abe-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:49:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-623f7352-343c-4630-a469-88111600d90b tempest-VolumesTestJSON-1518774991 None] Lock "cinder-ee2ffd0d-f27f-421e-bdd7-beba4b080abe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:49:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-623f7352-343c-4630-a469-88111600d90b tempest-VolumesTestJSON-1518774991 None] Acquiring lock "cinder-quobyte-ee2ffd0d-f27f-421e-bdd7-beba4b080abe" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:49:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-623f7352-343c-4630-a469-88111600d90b tempest-VolumesTestJSON-1518774991 None] Lock "cinder-quobyte-ee2ffd0d-f27f-421e-bdd7-beba4b080abe" acquired by "delete_volume" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:49:26 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ad32cf-819d-4d41-8a23-a7a529b5a151]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:49:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-623f7352-343c-4630-a469-88111600d90b tempest-VolumesTestJSON-1518774991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee2ffd0d-f27f-421e-bdd7-beba4b080abe {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:26 devstack sudo[84283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee2ffd0d-f27f-421e-bdd7-beba4b080abe Apr 28 05:49:26 devstack sudo[84283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:27 devstack sudo[84283]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-623f7352-343c-4630-a469-88111600d90b tempest-VolumesTestJSON-1518774991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee2ffd0d-f27f-421e-bdd7-beba4b080abe" returned: 0 in 1.012s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-623f7352-343c-4630-a469-88111600d90b tempest-VolumesTestJSON-1518774991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee2ffd0d-f27f-421e-bdd7-beba4b080abe {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:27 devstack sudo[84288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee2ffd0d-f27f-421e-bdd7-beba4b080abe Apr 28 05:49:27 devstack sudo[84288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:28 devstack sudo[84288]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-623f7352-343c-4630-a469-88111600d90b tempest-VolumesTestJSON-1518774991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee2ffd0d-f27f-421e-bdd7-beba4b080abe" returned: 0 in 0.678s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-623f7352-343c-4630-a469-88111600d90b tempest-VolumesTestJSON-1518774991 None] Lock "cinder-quobyte-ee2ffd0d-f27f-421e-bdd7-beba4b080abe" released by "delete_volume" :: held 1.762s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:49:28 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-623f7352-343c-4630-a469-88111600d90b tempest-VolumesTestJSON-1518774991 None] Created reservations ['f6ec6948-8497-48b8-a0ec-7ff4f9cd1396', '04bf97c1-7f37-4090-9784-ed8cda97524f', '0c7f699d-de65-4725-a6aa-0769fa71db15', '412d09f2-3e77-4593-a0eb-bf956b75460b'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:49:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-623f7352-343c-4630-a469-88111600d90b tempest-VolumesTestJSON-1518774991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-623f7352-343c-4630-a469-88111600d90b tempest-VolumesTestJSON-1518774991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-623f7352-343c-4630-a469-88111600d90b tempest-VolumesTestJSON-1518774991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:49:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-623f7352-343c-4630-a469-88111600d90b tempest-VolumesTestJSON-1518774991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:49:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-623f7352-343c-4630-a469-88111600d90b tempest-VolumesTestJSON-1518774991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-623f7352-343c-4630-a469-88111600d90b tempest-VolumesTestJSON-1518774991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:28 devstack sudo[84296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:49:28 devstack sudo[84296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:29 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9f50cefb-f02a-4d3d-87e5-5cf90a5dd05c tempest-VolumesTestJSON-1518774991 None] Acquiring lock "cinder-ee3073cd-1257-4c05-99f9-75a04822fbb8-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:49:29 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9f50cefb-f02a-4d3d-87e5-5cf90a5dd05c tempest-VolumesTestJSON-1518774991 None] Lock "cinder-ee3073cd-1257-4c05-99f9-75a04822fbb8-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:49:29 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9f50cefb-f02a-4d3d-87e5-5cf90a5dd05c tempest-VolumesTestJSON-1518774991 None] Acquiring lock "cinder-quobyte-ee3073cd-1257-4c05-99f9-75a04822fbb8" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:49:29 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9f50cefb-f02a-4d3d-87e5-5cf90a5dd05c tempest-VolumesTestJSON-1518774991 None] Lock "cinder-quobyte-ee3073cd-1257-4c05-99f9-75a04822fbb8" acquired by "delete_volume" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:49:29 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3cee76-225f-4910-9cc7-78d64b3069e0]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:49:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9f50cefb-f02a-4d3d-87e5-5cf90a5dd05c tempest-VolumesTestJSON-1518774991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee3073cd-1257-4c05-99f9-75a04822fbb8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:29 devstack sudo[84311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee3073cd-1257-4c05-99f9-75a04822fbb8 Apr 28 05:49:29 devstack sudo[84311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:30 devstack sudo[84296]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-623f7352-343c-4630-a469-88111600d90b tempest-VolumesTestJSON-1518774991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 1.365s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:30 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-623f7352-343c-4630-a469-88111600d90b tempest-VolumesTestJSON-1518774991 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:49:30 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-623f7352-343c-4630-a469-88111600d90b tempest-VolumesTestJSON-1518774991 None] Deleted volume successfully. Apr 28 05:49:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-623f7352-343c-4630-a469-88111600d90b tempest-VolumesTestJSON-1518774991 None] Lock "cinder-ee2ffd0d-f27f-421e-bdd7-beba4b080abe-delete_volume" released by "delete_volume" :: held 3.591s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:49:30 devstack sudo[84311]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9f50cefb-f02a-4d3d-87e5-5cf90a5dd05c tempest-VolumesTestJSON-1518774991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee3073cd-1257-4c05-99f9-75a04822fbb8" returned: 0 in 1.274s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9f50cefb-f02a-4d3d-87e5-5cf90a5dd05c tempest-VolumesTestJSON-1518774991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee3073cd-1257-4c05-99f9-75a04822fbb8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:30 devstack sudo[84333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee3073cd-1257-4c05-99f9-75a04822fbb8 Apr 28 05:49:30 devstack sudo[84333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:31 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-29f8a256-9be8-40e0-864b-0a9e0be72f3d tempest-GroupsV320Test-1686241846 None] Group tempest-GroupsV320Test-Group-122183425: creating Apr 28 05:49:31 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-29f8a256-9be8-40e0-864b-0a9e0be72f3d tempest-GroupsV320Test-1686241846 None] Group tempest-GroupsV320Test-Group-122183425: created successfully Apr 28 05:49:31 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-29f8a256-9be8-40e0-864b-0a9e0be72f3d tempest-GroupsV320Test-1686241846 None] Create group completed successfully. Apr 28 05:49:31 devstack sudo[84333]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9f50cefb-f02a-4d3d-87e5-5cf90a5dd05c tempest-VolumesTestJSON-1518774991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ee3073cd-1257-4c05-99f9-75a04822fbb8" returned: 0 in 1.015s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:31 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9f50cefb-f02a-4d3d-87e5-5cf90a5dd05c tempest-VolumesTestJSON-1518774991 None] Lock "cinder-quobyte-ee3073cd-1257-4c05-99f9-75a04822fbb8" released by "delete_volume" :: held 2.358s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:49:31 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-9f50cefb-f02a-4d3d-87e5-5cf90a5dd05c tempest-VolumesTestJSON-1518774991 None] Created reservations ['ca1ebe0b-c1a4-41af-86ec-2a3afb6325ae', '3f496d45-c267-477e-a8d1-3f040683214b', '547d4a76-2291-4298-a682-b1b803e0e2eb', '332cb5c4-2017-4cbd-bcfd-48e7e11cdcf3'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:49:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9f50cefb-f02a-4d3d-87e5-5cf90a5dd05c tempest-VolumesTestJSON-1518774991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9f50cefb-f02a-4d3d-87e5-5cf90a5dd05c tempest-VolumesTestJSON-1518774991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-9f50cefb-f02a-4d3d-87e5-5cf90a5dd05c tempest-VolumesTestJSON-1518774991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:49:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-9f50cefb-f02a-4d3d-87e5-5cf90a5dd05c tempest-VolumesTestJSON-1518774991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:49:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9f50cefb-f02a-4d3d-87e5-5cf90a5dd05c tempest-VolumesTestJSON-1518774991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9f50cefb-f02a-4d3d-87e5-5cf90a5dd05c tempest-VolumesTestJSON-1518774991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:31 devstack sudo[84337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:49:31 devstack sudo[84337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:32 devstack sudo[84337]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9f50cefb-f02a-4d3d-87e5-5cf90a5dd05c tempest-VolumesTestJSON-1518774991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.582s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:32 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-9f50cefb-f02a-4d3d-87e5-5cf90a5dd05c tempest-VolumesTestJSON-1518774991 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:49:32 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-9f50cefb-f02a-4d3d-87e5-5cf90a5dd05c tempest-VolumesTestJSON-1518774991 None] Deleted volume successfully. Apr 28 05:49:32 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9f50cefb-f02a-4d3d-87e5-5cf90a5dd05c tempest-VolumesTestJSON-1518774991 None] Lock "cinder-ee3073cd-1257-4c05-99f9-75a04822fbb8-delete_volume" released by "delete_volume" :: held 3.222s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:49:32 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b632ae44-1e40-491a-992d-f40c5a2715b8 tempest-VolumesTestJSON-1518774991 None] Acquiring lock "cinder-bee91e1a-cd72-4d2e-bec2-3a27a061150f-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:49:32 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b632ae44-1e40-491a-992d-f40c5a2715b8 tempest-VolumesTestJSON-1518774991 None] Lock "cinder-bee91e1a-cd72-4d2e-bec2-3a27a061150f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:49:32 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b632ae44-1e40-491a-992d-f40c5a2715b8 tempest-VolumesTestJSON-1518774991 None] Acquiring lock "cinder-quobyte-bee91e1a-cd72-4d2e-bec2-3a27a061150f" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:49:32 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b632ae44-1e40-491a-992d-f40c5a2715b8 tempest-VolumesTestJSON-1518774991 None] Lock "cinder-quobyte-bee91e1a-cd72-4d2e-bec2-3a27a061150f" acquired by "delete_volume" :: waited 0.026s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:49:32 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12a9a8c-90f0-4614-83e9-cdc21529914c]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:49:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b632ae44-1e40-491a-992d-f40c5a2715b8 tempest-VolumesTestJSON-1518774991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-bee91e1a-cd72-4d2e-bec2-3a27a061150f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:33 devstack sudo[84340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-bee91e1a-cd72-4d2e-bec2-3a27a061150f Apr 28 05:49:33 devstack sudo[84340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Flow 'volume_create_manager' (104bdf3a-38f9-4b9a-b4da-6eee4b2bbe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb9a018-c948-4517-9432-270357e4c24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb9a018-c948-4517-9432-270357e4c24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-532042836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89afb21b-befe-430b-ab2f-61b849417966,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e28441e3a2ef44f38f1e39cfd0238ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:49:33Z,use_quota=True,user_id='f63e2cc8e5a744d98b9b3589f91ec1c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1944ea5c-a138-4ba1-b690-e7378bda7733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1944ea5c-a138-4ba1-b690-e7378bda7733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01983e05-e7d9-4c40-a117-d1ad80f942d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01983e05-e7d9-4c40-a117-d1ad80f942d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89afb21b-befe-430b-ab2f-61b849417966', 'volume_name': 'volume-89afb21b-befe-430b-ab2f-61b849417966', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c8d00d-014f-4a79-ba1a-b88f2f8e38b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c8d00d-014f-4a79-ba1a-b88f2f8e38b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1961673-2531-421c-999e-6b47743be632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:33 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Volume 89afb21b-befe-430b-ab2f-61b849417966: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89afb21b-befe-430b-ab2f-61b849417966', 'volume_size': 1} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-532042836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89afb21b-befe-430b-ab2f-61b849417966,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e28441e3a2ef44f38f1e39cfd0238ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:49:33Z,use_quota=True,user_id='f63e2cc8e5a744d98b9b3589f91ec1c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Creating volume 89afb21b-befe-430b-ab2f-61b849417966 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:49:33 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89afb21b-befe-430b-ab2f-61b849417966 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:33 devstack sudo[84359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89afb21b-befe-430b-ab2f-61b849417966 1073741824 Apr 28 05:49:33 devstack sudo[84359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-66e7b38b-975c-4610-9fb3-786fdd576ec6 tempest-GroupsV320Test-1686241846 None] Created reservations ['5e910cb6-794f-4cd2-b90a-62138ee8ca75'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-66e7b38b-975c-4610-9fb3-786fdd576ec6 tempest-GroupsV320Test-1686241846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-66e7b38b-975c-4610-9fb3-786fdd576ec6 tempest-GroupsV320Test-1686241846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-66e7b38b-975c-4610-9fb3-786fdd576ec6 tempest-GroupsV320Test-1686241846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-66e7b38b-975c-4610-9fb3-786fdd576ec6 tempest-GroupsV320Test-1686241846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-66e7b38b-975c-4610-9fb3-786fdd576ec6 tempest-GroupsV320Test-1686241846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-66e7b38b-975c-4610-9fb3-786fdd576ec6 tempest-GroupsV320Test-1686241846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:33 devstack sudo[84379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:49:33 devstack sudo[84379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:34 devstack sudo[84340]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b632ae44-1e40-491a-992d-f40c5a2715b8 tempest-VolumesTestJSON-1518774991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-bee91e1a-cd72-4d2e-bec2-3a27a061150f" returned: 0 in 1.227s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b632ae44-1e40-491a-992d-f40c5a2715b8 tempest-VolumesTestJSON-1518774991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-bee91e1a-cd72-4d2e-bec2-3a27a061150f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:34 devstack sudo[84384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-bee91e1a-cd72-4d2e-bec2-3a27a061150f Apr 28 05:49:34 devstack sudo[84384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:34 devstack sudo[84359]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89afb21b-befe-430b-ab2f-61b849417966 1073741824" returned: 0 in 0.884s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89afb21b-befe-430b-ab2f-61b849417966 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:34 devstack sudo[84379]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-66e7b38b-975c-4610-9fb3-786fdd576ec6 tempest-GroupsV320Test-1686241846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.649s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:34 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-66e7b38b-975c-4610-9fb3-786fdd576ec6 tempest-GroupsV320Test-1686241846 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:49:34 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-66e7b38b-975c-4610-9fb3-786fdd576ec6 tempest-GroupsV320Test-1686241846 None] Delete group completed successfully. Apr 28 05:49:34 devstack sudo[84390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89afb21b-befe-430b-ab2f-61b849417966 Apr 28 05:49:34 devstack sudo[84390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:34 devstack sudo[84384]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b632ae44-1e40-491a-992d-f40c5a2715b8 tempest-VolumesTestJSON-1518774991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-bee91e1a-cd72-4d2e-bec2-3a27a061150f" returned: 0 in 0.496s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b632ae44-1e40-491a-992d-f40c5a2715b8 tempest-VolumesTestJSON-1518774991 None] Lock "cinder-quobyte-bee91e1a-cd72-4d2e-bec2-3a27a061150f" released by "delete_volume" :: held 1.797s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:49:34 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-b632ae44-1e40-491a-992d-f40c5a2715b8 tempest-VolumesTestJSON-1518774991 None] Created reservations ['8e5b3f19-7c65-4a86-825f-6223d066b6db', 'd2d96e82-ea43-481c-a5d5-de74ad756fb2', 'b7f066e3-16d1-44fd-af32-ef44b4b48688', '13854bbf-6c2b-4603-ab80-3ae825cbf87b'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:49:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b632ae44-1e40-491a-992d-f40c5a2715b8 tempest-VolumesTestJSON-1518774991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b632ae44-1e40-491a-992d-f40c5a2715b8 tempest-VolumesTestJSON-1518774991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:34 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b632ae44-1e40-491a-992d-f40c5a2715b8 tempest-VolumesTestJSON-1518774991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:49:34 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b632ae44-1e40-491a-992d-f40c5a2715b8 tempest-VolumesTestJSON-1518774991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:49:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b632ae44-1e40-491a-992d-f40c5a2715b8 tempest-VolumesTestJSON-1518774991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b632ae44-1e40-491a-992d-f40c5a2715b8 tempest-VolumesTestJSON-1518774991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:34 devstack sudo[84393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:49:34 devstack sudo[84393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:34 devstack sudo[84390]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89afb21b-befe-430b-ab2f-61b849417966" returned: 0 in 0.479s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:34 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:49:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:34 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1961673-2531-421c-999e-6b47743be632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89afb21b-befe-430b-ab2f-61b849417966', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:34 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f719300e-baf6-469c-ae14-14d1889207f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:35 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Volume volume-89afb21b-befe-430b-ab2f-61b849417966 (89afb21b-befe-430b-ab2f-61b849417966): created successfully Apr 28 05:49:35 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f719300e-baf6-469c-ae14-14d1889207f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:35 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Flow 'volume_create_manager' (104bdf3a-38f9-4b9a-b4da-6eee4b2bbe65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:49:35 devstack cinder-volume[81829]: INFO cinder.volume.manager [req-7877a477-3bc8-4baa-ab35-bd0093a73536 req-48ad06a4-3c4f-4704-8af3-52df5edaf17f tempest-VolumesGetTestJSON-839706602 None] Created volume successfully. Apr 28 05:49:35 devstack sudo[84393]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b632ae44-1e40-491a-992d-f40c5a2715b8 tempest-VolumesTestJSON-1518774991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.555s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:35 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-b632ae44-1e40-491a-992d-f40c5a2715b8 tempest-VolumesTestJSON-1518774991 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:49:35 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-b632ae44-1e40-491a-992d-f40c5a2715b8 tempest-VolumesTestJSON-1518774991 None] Deleted volume successfully. Apr 28 05:49:35 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b632ae44-1e40-491a-992d-f40c5a2715b8 tempest-VolumesTestJSON-1518774991 None] Lock "cinder-bee91e1a-cd72-4d2e-bec2-3a27a061150f-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:49:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-147a3718-2044-40d9-a86b-0b096951d23b req-9726d67f-0125-467b-99f4-f483199ac2f5 tempest-VolumesGetTestJSON-839706602 None] Acquiring lock "cinder-89afb21b-befe-430b-ab2f-61b849417966-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:49:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-147a3718-2044-40d9-a86b-0b096951d23b req-9726d67f-0125-467b-99f4-f483199ac2f5 tempest-VolumesGetTestJSON-839706602 None] Lock "cinder-89afb21b-befe-430b-ab2f-61b849417966-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:49:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-147a3718-2044-40d9-a86b-0b096951d23b req-9726d67f-0125-467b-99f4-f483199ac2f5 tempest-VolumesGetTestJSON-839706602 None] Acquiring lock "cinder-quobyte-89afb21b-befe-430b-ab2f-61b849417966" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:49:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-147a3718-2044-40d9-a86b-0b096951d23b req-9726d67f-0125-467b-99f4-f483199ac2f5 tempest-VolumesGetTestJSON-839706602 None] Lock "cinder-quobyte-89afb21b-befe-430b-ab2f-61b849417966" acquired by "delete_volume" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:49:36 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[113b6c24-0905-4002-8a21-48ed0bb94987]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:49:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-147a3718-2044-40d9-a86b-0b096951d23b req-9726d67f-0125-467b-99f4-f483199ac2f5 tempest-VolumesGetTestJSON-839706602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89afb21b-befe-430b-ab2f-61b849417966 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:36 devstack sudo[84397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89afb21b-befe-430b-ab2f-61b849417966 Apr 28 05:49:36 devstack sudo[84397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:37 devstack sudo[84397]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-147a3718-2044-40d9-a86b-0b096951d23b req-9726d67f-0125-467b-99f4-f483199ac2f5 tempest-VolumesGetTestJSON-839706602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89afb21b-befe-430b-ab2f-61b849417966" returned: 0 in 0.832s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-147a3718-2044-40d9-a86b-0b096951d23b req-9726d67f-0125-467b-99f4-f483199ac2f5 tempest-VolumesGetTestJSON-839706602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89afb21b-befe-430b-ab2f-61b849417966 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:37 devstack sudo[84405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89afb21b-befe-430b-ab2f-61b849417966 Apr 28 05:49:37 devstack sudo[84405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:37 devstack sudo[84405]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-147a3718-2044-40d9-a86b-0b096951d23b req-9726d67f-0125-467b-99f4-f483199ac2f5 tempest-VolumesGetTestJSON-839706602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89afb21b-befe-430b-ab2f-61b849417966" returned: 0 in 0.728s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-147a3718-2044-40d9-a86b-0b096951d23b req-9726d67f-0125-467b-99f4-f483199ac2f5 tempest-VolumesGetTestJSON-839706602 None] Lock "cinder-quobyte-89afb21b-befe-430b-ab2f-61b849417966" released by "delete_volume" :: held 1.614s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:49:37 devstack cinder-volume[81829]: DEBUG cinder.quota [req-147a3718-2044-40d9-a86b-0b096951d23b req-9726d67f-0125-467b-99f4-f483199ac2f5 tempest-VolumesGetTestJSON-839706602 None] Created reservations ['29552d80-765f-4f48-8eb7-a9327f4e703c', '35cc0292-f7f3-4160-98c7-bae084736b5a', '77af1388-5162-4408-9d9a-8c7bbf950b4d', '18aa33e7-59df-4bea-b554-ee834bbeaaaf'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:49:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-147a3718-2044-40d9-a86b-0b096951d23b req-9726d67f-0125-467b-99f4-f483199ac2f5 tempest-VolumesGetTestJSON-839706602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-147a3718-2044-40d9-a86b-0b096951d23b req-9726d67f-0125-467b-99f4-f483199ac2f5 tempest-VolumesGetTestJSON-839706602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:38 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-147a3718-2044-40d9-a86b-0b096951d23b req-9726d67f-0125-467b-99f4-f483199ac2f5 tempest-VolumesGetTestJSON-839706602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:49:38 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-147a3718-2044-40d9-a86b-0b096951d23b req-9726d67f-0125-467b-99f4-f483199ac2f5 tempest-VolumesGetTestJSON-839706602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:49:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-147a3718-2044-40d9-a86b-0b096951d23b req-9726d67f-0125-467b-99f4-f483199ac2f5 tempest-VolumesGetTestJSON-839706602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-147a3718-2044-40d9-a86b-0b096951d23b req-9726d67f-0125-467b-99f4-f483199ac2f5 tempest-VolumesGetTestJSON-839706602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:38 devstack sudo[84411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:49:38 devstack sudo[84411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:38 devstack sudo[84411]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-147a3718-2044-40d9-a86b-0b096951d23b req-9726d67f-0125-467b-99f4-f483199ac2f5 tempest-VolumesGetTestJSON-839706602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.530s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:38 devstack cinder-volume[81829]: DEBUG cinder.manager [req-147a3718-2044-40d9-a86b-0b096951d23b req-9726d67f-0125-467b-99f4-f483199ac2f5 tempest-VolumesGetTestJSON-839706602 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:49:38 devstack cinder-volume[81829]: INFO cinder.volume.manager [req-147a3718-2044-40d9-a86b-0b096951d23b req-9726d67f-0125-467b-99f4-f483199ac2f5 tempest-VolumesGetTestJSON-839706602 None] Deleted volume successfully. Apr 28 05:49:38 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-147a3718-2044-40d9-a86b-0b096951d23b req-9726d67f-0125-467b-99f4-f483199ac2f5 tempest-VolumesGetTestJSON-839706602 None] Lock "cinder-89afb21b-befe-430b-ab2f-61b849417966-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:49:40 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-0081fc74-df0c-4b9c-a1ad-1cf17d7196bf tempest-GroupsV314Test-1957042941 None] Group tempest-GroupsV314Test-Group-700856921: creating Apr 28 05:49:40 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-0081fc74-df0c-4b9c-a1ad-1cf17d7196bf tempest-GroupsV314Test-1957042941 None] Group tempest-GroupsV314Test-Group-700856921: created successfully Apr 28 05:49:40 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-0081fc74-df0c-4b9c-a1ad-1cf17d7196bf tempest-GroupsV314Test-1957042941 None] Create group completed successfully. Apr 28 05:49:40 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:49:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Flow 'volume_create_manager' (9f90a8d0-b047-4559-a319-1271fc03ebf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:49:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c79489-6e84-4e22-8904-37b22fe3ba16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c79489-6e84-4e22-8904-37b22fe3ba16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1930783328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be206168-e028-4825-8479-22034983745f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881c82d32bf64262b1cd375dc06f28bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:49:41Z,use_quota=True,user_id='74dd215146a54e7fbb4f24dbbcfeb2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f8d837-4dad-479d-ac02-6b76d0057737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f8d837-4dad-479d-ac02-6b76d0057737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d585c5ee-6dc3-4074-838c-c40fd5db4a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d585c5ee-6dc3-4074-838c-c40fd5db4a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be206168-e028-4825-8479-22034983745f', 'volume_name': 'volume-be206168-e028-4825-8479-22034983745f', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c08b7f2-a133-4c74-85ac-aa95c8a894dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c08b7f2-a133-4c74-85ac-aa95c8a894dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e013e4dc-369b-4ed8-88a7-42fbf2e10baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:40 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Volume be206168-e028-4825-8479-22034983745f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be206168-e028-4825-8479-22034983745f', 'volume_size': 1} Apr 28 05:49:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1930783328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be206168-e028-4825-8479-22034983745f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881c82d32bf64262b1cd375dc06f28bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:49:41Z,use_quota=True,user_id='74dd215146a54e7fbb4f24dbbcfeb2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:49:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Creating volume be206168-e028-4825-8479-22034983745f {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:49:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:49:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:49:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:49:40 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:49:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:40 devstack sudo[84415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f 1073741824 Apr 28 05:49:40 devstack sudo[84415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:41 devstack sudo[84415]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f 1073741824" returned: 0 in 0.644s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:41 devstack sudo[84420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f Apr 28 05:49:41 devstack sudo[84420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:41 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:49:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Flow 'volume_create_manager' (296f4251-055e-4f00-883d-29c45c943521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:49:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda1e0e2-afa2-4bbc-b7ad-0d4fe9a8b888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda1e0e2-afa2-4bbc-b7ad-0d4fe9a8b888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1514616892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60566a1e-d71e-4955-a87c-4daf408d6d94,host='devstack@QuobyteHD#QuobyteHD',id=c72cadd9-bb1e-4d59-b5e1-c275998bcf73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761baa144ecd4ec5947ce3259fa4640f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:49:42Z,use_quota=True,user_id='5feca6849eeb4193b2c714900579a8c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18f12474-8b87-43c8-928a-0bb641839ac9),volume_type_id=18f12474-8b87-43c8-928a-0bb641839ac9)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67b1dc7-7b22-4b4e-9b9f-7a823dcd3494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67b1dc7-7b22-4b4e-9b9f-7a823dcd3494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8952bb1-6c8c-4654-9023-2d8070231dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8952bb1-6c8c-4654-9023-2d8070231dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c72cadd9-bb1e-4d59-b5e1-c275998bcf73', 'volume_name': 'volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0faa0bc5-e11d-427b-935a-1a248d2ff31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0faa0bc5-e11d-427b-935a-1a248d2ff31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca6fa95-c756-46ac-b762-bcaf320a2d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:41 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Volume c72cadd9-bb1e-4d59-b5e1-c275998bcf73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73', 'volume_size': 1} Apr 28 05:49:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:42 devstack sudo[84420]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f" returned: 0 in 0.671s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:49:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.397s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=60566a1e-d71e-4955-a87c-4daf408d6d94,created_at=2026-04-28T03:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1514616892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60566a1e-d71e-4955-a87c-4daf408d6d94,host='devstack@QuobyteHD#QuobyteHD',id=c72cadd9-bb1e-4d59-b5e1-c275998bcf73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761baa144ecd4ec5947ce3259fa4640f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:49:42Z,use_quota=True,user_id='5feca6849eeb4193b2c714900579a8c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18f12474-8b87-43c8-928a-0bb641839ac9),volume_type_id=18f12474-8b87-43c8-928a-0bb641839ac9)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:49:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Creating volume c72cadd9-bb1e-4d59-b5e1-c275998bcf73 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:49:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:49:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:49:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:49:42 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:49:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e013e4dc-369b-4ed8-88a7-42fbf2e10baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be206168-e028-4825-8479-22034983745f', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11aaedf9-b0dd-494d-9719-866028f76bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:42 devstack sudo[84423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 1073741824 Apr 28 05:49:42 devstack sudo[84423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:42 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Volume volume-be206168-e028-4825-8479-22034983745f (be206168-e028-4825-8479-22034983745f): created successfully Apr 28 05:49:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11aaedf9-b0dd-494d-9719-866028f76bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Flow 'volume_create_manager' (9f90a8d0-b047-4559-a319-1271fc03ebf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:49:42 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-021b2531-e0e8-4124-956b-b09425decb95 tempest-SnapshotsActionsTest-1636782161 None] Created volume successfully. Apr 28 05:49:42 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-4ae4be2a-5778-48b3-899c-15a7a1fab913 tempest-GroupSnapshotsV319Test-1031575877 None] Group tempest-GroupSnapshotsV319Test-Group-257100430: creating Apr 28 05:49:42 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-4ae4be2a-5778-48b3-899c-15a7a1fab913 tempest-GroupSnapshotsV319Test-1031575877 None] Group tempest-GroupSnapshotsV319Test-Group-257100430: created successfully Apr 28 05:49:42 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-4ae4be2a-5778-48b3-899c-15a7a1fab913 tempest-GroupSnapshotsV319Test-1031575877 None] Create group completed successfully. Apr 28 05:49:43 devstack sudo[84423]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 1073741824" returned: 0 in 0.876s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:43 devstack sudo[84428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 Apr 28 05:49:43 devstack sudo[84428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-35cdb91b-a503-4d68-b813-dcd87a6053db tempest-SnapshotsActionsTest-1636782161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Flow 'volume_create_manager' (c27ecb4c-e010-4310-9eb1-0505b1d7dc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e723407f-a600-4514-9f35-d551106fe547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e723407f-a600-4514-9f35-d551106fe547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:49:43Z,deleted=False,deleted_at=None,display_description='',display_name='646b938d-3af0-4924-bf88-1085ec9f6475-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e442449-d92d-44f5-91a4-1645d5e95a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e69f13ede9a434c93e4f4fbe6365369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:49:44Z,use_quota=True,user_id='b1bfcb1acebe4af1b50acf7947a89abe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0ece11-1fa2-43da-9c47-aaca2c40081f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0ece11-1fa2-43da-9c47-aaca2c40081f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6015576-90ce-4039-972b-4bc7074fd893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6015576-90ce-4039-972b-4bc7074fd893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e442449-d92d-44f5-91a4-1645d5e95a7e', 'volume_name': 'volume-0e442449-d92d-44f5-91a4-1645d5e95a7e', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20aeb87c-e8b0-40ad-bffe-ec4711573f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20aeb87c-e8b0-40ad-bffe-ec4711573f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d97341-bc20-42d9-848d-0420e4d68bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:43 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Volume 0e442449-d92d-44f5-91a4-1645d5e95a7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e442449-d92d-44f5-91a4-1645d5e95a7e', 'volume_size': 1} Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:43 devstack sudo[84428]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73" returned: 0 in 0.689s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-35cdb91b-a503-4d68-b813-dcd87a6053db tempest-SnapshotsActionsTest-1636782161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.553s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca6fa95-c756-46ac-b762-bcaf320a2d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df15b921-c8da-4b43-8ae9-b3a51244a6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-35cdb91b-a503-4d68-b813-dcd87a6053db tempest-SnapshotsActionsTest-1636782161 None] Creating offline snapshot 219cfc86-bfad-4968-89e4-a1b22faefb6a of volume be206168-e028-4825-8479-22034983745f {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:49:43 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Volume volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 (c72cadd9-bb1e-4d59-b5e1-c275998bcf73): created successfully Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df15b921-c8da-4b43-8ae9-b3a51244a6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Flow 'volume_create_manager' (296f4251-055e-4f00-883d-29c45c943521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc805df4-3683-4bbc-bc51-b15a2736860a]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:49:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35cdb91b-a503-4d68-b813-dcd87a6053db tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:43 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-66580a97-3d84-4c88-8998-c03f2782e821 tempest-GroupsV314Test-1957042941 None] Created volume successfully. Apr 28 05:49:44 devstack sudo[84433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f Apr 28 05:49:44 devstack sudo[84433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:44 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:49:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Flow 'volume_create_manager' (bb217f96-9ea3-450f-8a31-c2ad279cfb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:49:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414d5f13-733e-46a5-b207-4dbfe9b2740c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414d5f13-733e-46a5-b207-4dbfe9b2740c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-696880210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a9359368-f6f8-4b52-b8d4-044c6f3225de,host='devstack@QuobyteHD#QuobyteHD',id=72c32e94-6c4b-41eb-bbf0-480e9c6d59c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2d6fbaa840c4d60a0802e4259321657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:49:44Z,use_quota=True,user_id='ad996403a8e449b8983430e859a046ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1f1d22c-96c6-4285-a6b9-183b2063188c),volume_type_id=c1f1d22c-96c6-4285-a6b9-183b2063188c)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24781af7-1d63-4aa3-808e-ee240e395eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24781af7-1d63-4aa3-808e-ee240e395eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36922db3-f1ff-4fa3-9a7a-31ca62618264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36922db3-f1ff-4fa3-9a7a-31ca62618264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72c32e94-6c4b-41eb-bbf0-480e9c6d59c5', 'volume_name': 'volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67fb2f65-08cc-4aff-9b19-fb1eae5feee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67fb2f65-08cc-4aff-9b19-fb1eae5feee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327e9b32-439d-42ec-9f62-a35028dd937e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:44 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Volume 72c32e94-6c4b-41eb-bbf0-480e9c6d59c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5', 'volume_size': 1} Apr 28 05:49:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:44 devstack sudo[84433]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35cdb91b-a503-4d68-b813-dcd87a6053db tempest-SnapshotsActionsTest-1636782161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f" returned: 0 in 0.614s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35cdb91b-a503-4d68-b813-dcd87a6053db tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:44 devstack sudo[84438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a 1G Apr 28 05:49:44 devstack sudo[84438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:45 devstack sudo[84438]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35cdb91b-a503-4d68-b813-dcd87a6053db tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a 1G" returned: 0 in 0.661s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35cdb91b-a503-4d68-b813-dcd87a6053db tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be206168-e028-4825-8479-22034983745f -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:45 devstack sudo[84443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be206168-e028-4825-8479-22034983745f -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a Apr 28 05:49:45 devstack sudo[84443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:45 devstack sudo[84443]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35cdb91b-a503-4d68-b813-dcd87a6053db tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be206168-e028-4825-8479-22034983745f -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a" returned: 0 in 0.481s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:45 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-35cdb91b-a503-4d68-b813-dcd87a6053db tempest-SnapshotsActionsTest-1636782161 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a is being set with open permissions: ugo+rw Apr 28 05:49:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35cdb91b-a503-4d68-b813-dcd87a6053db tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:45 devstack sudo[84448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a Apr 28 05:49:45 devstack sudo[84448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:46 devstack sudo[84448]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35cdb91b-a503-4d68-b813-dcd87a6053db tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a" returned: 0 in 0.466s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35cdb91b-a503-4d68-b813-dcd87a6053db tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:46 devstack sudo[84451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.info Apr 28 05:49:46 devstack sudo[84451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:46 devstack sudo[84451]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35cdb91b-a503-4d68-b813-dcd87a6053db tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.info" returned: 0 in 0.453s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:46 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-35cdb91b-a503-4d68-b813-dcd87a6053db tempest-SnapshotsActionsTest-1636782161 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.info is being set with open permissions: ugo+rw Apr 28 05:49:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35cdb91b-a503-4d68-b813-dcd87a6053db tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:46 devstack sudo[84454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.info Apr 28 05:49:46 devstack sudo[84454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:47 devstack sudo[84454]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35cdb91b-a503-4d68-b813-dcd87a6053db tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.info" returned: 0 in 0.435s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-35cdb91b-a503-4d68-b813-dcd87a6053db tempest-SnapshotsActionsTest-1636782161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.225s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.323s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:47 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:49:43Z,deleted=False,deleted_at=None,display_description='',display_name='646b938d-3af0-4924-bf88-1085ec9f6475-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e442449-d92d-44f5-91a4-1645d5e95a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e69f13ede9a434c93e4f4fbe6365369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:49:44Z,use_quota=True,user_id='b1bfcb1acebe4af1b50acf7947a89abe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:49:47 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Creating volume 0e442449-d92d-44f5-91a4-1645d5e95a7e {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:49:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:47 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:49:47 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:49:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:47 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:49:47 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:49:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e442449-d92d-44f5-91a4-1645d5e95a7e 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:47 devstack sudo[84457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e442449-d92d-44f5-91a4-1645d5e95a7e 1073741824 Apr 28 05:49:47 devstack sudo[84457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:47 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-35cdb91b-a503-4d68-b813-dcd87a6053db tempest-SnapshotsActionsTest-1636782161 None] Create snapshot completed successfully Apr 28 05:49:47 devstack sudo[84457]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e442449-d92d-44f5-91a4-1645d5e95a7e 1073741824" returned: 0 in 0.677s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e442449-d92d-44f5-91a4-1645d5e95a7e {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:47 devstack sudo[84462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e442449-d92d-44f5-91a4-1645d5e95a7e Apr 28 05:49:47 devstack sudo[84462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f9e692ec-d74f-47fb-965e-a6143d9af86a tempest-SnapshotsActionsTest-1636782161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:48 devstack sudo[84462]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e442449-d92d-44f5-91a4-1645d5e95a7e" returned: 0 in 0.474s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:48 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:49:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.820s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:48 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a9359368-f6f8-4b52-b8d4-044c6f3225de,created_at=2026-04-28T03:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-696880210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a9359368-f6f8-4b52-b8d4-044c6f3225de,host='devstack@QuobyteHD#QuobyteHD',id=72c32e94-6c4b-41eb-bbf0-480e9c6d59c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2d6fbaa840c4d60a0802e4259321657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:49:44Z,use_quota=True,user_id='ad996403a8e449b8983430e859a046ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1f1d22c-96c6-4285-a6b9-183b2063188c),volume_type_id=c1f1d22c-96c6-4285-a6b9-183b2063188c)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:49:48 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Creating volume 72c32e94-6c4b-41eb-bbf0-480e9c6d59c5 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:49:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:48 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:49:48 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:49:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:48 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:49:48 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:49:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:48 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d97341-bc20-42d9-848d-0420e4d68bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e442449-d92d-44f5-91a4-1645d5e95a7e', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:48 devstack sudo[84465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5 1073741824 Apr 28 05:49:48 devstack sudo[84465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:48 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3db079-7f81-4cb8-b054-788f283d464d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:48 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Volume volume-0e442449-d92d-44f5-91a4-1645d5e95a7e (0e442449-d92d-44f5-91a4-1645d5e95a7e): created successfully Apr 28 05:49:48 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3db079-7f81-4cb8-b054-788f283d464d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:48 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Flow 'volume_create_manager' (c27ecb4c-e010-4310-9eb1-0505b1d7dc13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:49:48 devstack cinder-volume[81829]: INFO cinder.volume.manager [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-dbeec1c6-69fd-4be4-aacd-a4a31362cd10 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Created volume successfully. Apr 28 05:49:48 devstack sudo[84465]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5 1073741824" returned: 0 in 0.603s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:48 devstack sudo[84470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5 Apr 28 05:49:48 devstack sudo[84470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:49 devstack sudo[84470]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5" returned: 0 in 0.451s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:49 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:49:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.454s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:49 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Cloning volume c72cadd9-bb1e-4d59-b5e1-c275998bcf73 to volume 1914f78e-9421-4cd9-b741-dfeda8eaf9e8 Apr 28 05:49:49 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327e9b32-439d-42ec-9f62-a35028dd937e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:49 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5878f7ba-bf67-423e-aea4-1c79baf18f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:49:49 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Volume volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5 (72c32e94-6c4b-41eb-bbf0-480e9c6d59c5): created successfully Apr 28 05:49:49 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5878f7ba-bf67-423e-aea4-1c79baf18f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:49:49 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Flow 'volume_create_manager' (bb217f96-9ea3-450f-8a31-c2ad279cfb8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:49:49 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Creating offline snapshot 81c10842-de46-495c-998d-ffd04746be47 of volume c72cadd9-bb1e-4d59-b5e1-c275998bcf73 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:49:49 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-dc9a8fb9-6bba-4a51-9a02-e1e52fa64cc9 tempest-GroupSnapshotsV319Test-1031575877 None] Created volume successfully. Apr 28 05:49:49 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[97eb6d30-aec2-4137-96df-be88f84c3741]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:49:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:49 devstack sudo[84473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 Apr 28 05:49:49 devstack sudo[84473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:50 devstack sudo[84473]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73" returned: 0 in 0.570s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:50 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-5d2d30ff-04d7-4c71-bfb1-1f9e8896424e tempest-GroupSnapshotsV319Test-1031575877 None] GroupSnapshot c750ff81-b4d3-41d5-aaba-becd7c24ad26: creating. Apr 28 05:49:50 devstack sudo[84485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47 1G Apr 28 05:49:50 devstack sudo[84485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5d2d30ff-04d7-4c71-bfb1-1f9e8896424e tempest-GroupSnapshotsV319Test-1031575877 None] Group snapshot c750ff81-b4d3-41d5-aaba-becd7c24ad26: creating. {{(pid=81829) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 28 05:49:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5d2d30ff-04d7-4c71-bfb1-1f9e8896424e tempest-GroupSnapshotsV319Test-1031575877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-83cdf065-a932-4981-a602-0097a20fd402 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:50 devstack sudo[84485]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47 1G" returned: 0 in 0.629s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:50 devstack sudo[84492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47 Apr 28 05:49:50 devstack sudo[84492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:51 devstack sudo[84492]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47" returned: 0 in 0.493s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:51 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 05:49:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:51 devstack sudo[84497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47 Apr 28 05:49:51 devstack sudo[84497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:51 devstack sudo[84497]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47" returned: 0 in 0.432s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:51 devstack sudo[84503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.info Apr 28 05:49:51 devstack sudo[84503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:52 devstack sudo[84503]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.info" returned: 0 in 0.446s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:52 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 05:49:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:52 devstack sudo[84509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.info Apr 28 05:49:52 devstack sudo[84509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:52 devstack sudo[84509]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.info" returned: 0 in 0.453s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:52 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Acquiring lock "cinder-quobyte-1914f78e-9421-4cd9-b741-dfeda8eaf9e8" by "_copy_volume_from_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:49:52 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Lock "cinder-quobyte-1914f78e-9421-4cd9-b741-dfeda8eaf9e8" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:49:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] snapshot: 81c10842-de46-495c-998d-ffd04746be47, volume: 1914f78e-9421-4cd9-b741-dfeda8eaf9e8, {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 05:49:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:49:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:49:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:49:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:49:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:49:52 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b952cb-274e-487b-88b5-417e222139a9]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:49:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:52 devstack sudo[84512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47 Apr 28 05:49:52 devstack sudo[84512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:53 devstack sudo[84512]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47" returned: 0 in 0.515s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:53 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:49:53 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] will copy from snapshot at /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 05:49:53 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Creating direct copy from snapshot {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 05:49:53 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d19236-d0d2-454a-9cd2-89b0b77e44c6]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:49:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:53 devstack sudo[84517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 Apr 28 05:49:53 devstack sudo[84517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:53 devstack sudo[84517]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73" returned: 0 in 0.532s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:53 devstack cinder-volume[81829]: DEBUG cinder.utils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Path /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1914f78e-9421-4cd9-b741-dfeda8eaf9e8 not found in is_blk_device check {{(pid=81829) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 05:49:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1914f78e-9421-4cd9-b741-dfeda8eaf9e8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:53 devstack sudo[84522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1914f78e-9421-4cd9-b741-dfeda8eaf9e8 Apr 28 05:49:53 devstack sudo[84522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:58 devstack sudo[84522]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1914f78e-9421-4cd9-b741-dfeda8eaf9e8" returned: 0 in 4.704s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:58 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a984bd1-8d8a-4387-a04d-7ec8e2ed4257]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:49:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:58 devstack sudo[84536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 Apr 28 05:49:58 devstack sudo[84536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:59 devstack sudo[84536]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73" returned: 0 in 0.646s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:59 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Image conversion details: src /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73, size 1024.00 MB, duration 4.71 sec, destination /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1914f78e-9421-4cd9-b741-dfeda8eaf9e8 {{(pid=81829) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:49:59 devstack cinder-volume[81829]: INFO cinder.image.image_utils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Converted 1024.00 MB image at 217.60 MB/s Apr 28 05:49:59 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1914f78e-9421-4cd9-b741-dfeda8eaf9e8 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 05:49:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1914f78e-9421-4cd9-b741-dfeda8eaf9e8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:59 devstack sudo[84541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1914f78e-9421-4cd9-b741-dfeda8eaf9e8 Apr 28 05:49:59 devstack sudo[84541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:49:59 devstack sudo[84541]: pam_unix(sudo:session): session closed for user root Apr 28 05:49:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1914f78e-9421-4cd9-b741-dfeda8eaf9e8" returned: 0 in 0.457s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:49:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Lock "cinder-quobyte-1914f78e-9421-4cd9-b741-dfeda8eaf9e8" released by "_copy_volume_from_snapshot" :: held 6.939s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:49:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Acquiring lock "cinder-quobyte-81c10842-de46-495c-998d-ffd04746be47" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:49:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Lock "cinder-quobyte-81c10842-de46-495c-998d-ffd04746be47" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:49:59 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Deleting offline snapshot 81c10842-de46-495c-998d-ffd04746be47 of volume c72cadd9-bb1e-4d59-b5e1-c275998bcf73 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:49:59 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] snapshot_file for this snap is: volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:49:59 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd53ce66-8c6a-4d03-9971-0659ab9c7993]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:49:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:49:59 devstack sudo[84544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47 Apr 28 05:49:59 devstack sudo[84544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:00 devstack sudo[84544]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47" returned: 0 in 0.510s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:00 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:50:00 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b88b95-9eeb-4ef8-9eaa-f15ec06d359d]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:00 devstack sudo[84549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 Apr 28 05:50:00 devstack sudo[84549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:00 devstack sudo[84549]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73" returned: 0 in 0.548s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:00 devstack sudo[84555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47 Apr 28 05:50:00 devstack sudo[84555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:01 devstack sudo[84555]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47" returned: 0 in 0.523s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:01 devstack sudo[84560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47 Apr 28 05:50:01 devstack sudo[84560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:01 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:SELECT=69,cinder:UPDATE=76,cinder:INSERT=20,cinder:DELETE=8 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:50:01 devstack sudo[84560]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73.81c10842-de46-495c-998d-ffd04746be47" returned: 0 in 0.502s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Lock "cinder-quobyte-81c10842-de46-495c-998d-ffd04746be47" released by "_delete_snapshot" :: held 2.172s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.356s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f9e692ec-d74f-47fb-965e-a6143d9af86a tempest-SnapshotsActionsTest-1636782161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.753s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-f9e692ec-d74f-47fb-965e-a6143d9af86a tempest-SnapshotsActionsTest-1636782161 None] Creating offline snapshot 2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a of volume be206168-e028-4825-8479-22034983745f {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:50:01 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee30a2f-db28-4f66-9f70-269cb0d6d3e9]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f9e692ec-d74f-47fb-965e-a6143d9af86a tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:01 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-4a2fd0b7-2ecb-4625-862d-11a043177089 tempest-GroupsV314Test-1957042941 None] Create group from source-group-60566a1e-d71e-4955-a87c-4daf408d6d94 completed successfully. Apr 28 05:50:01 devstack sudo[84563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a Apr 28 05:50:01 devstack sudo[84563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:02 devstack sudo[84563]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f9e692ec-d74f-47fb-965e-a6143d9af86a tempest-SnapshotsActionsTest-1636782161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a" returned: 0 in 0.522s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:02 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-f9e692ec-d74f-47fb-965e-a6143d9af86a tempest-SnapshotsActionsTest-1636782161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be206168-e028-4825-8479-22034983745f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:50:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f9e692ec-d74f-47fb-965e-a6143d9af86a tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:02 devstack sudo[84568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a 1G Apr 28 05:50:02 devstack sudo[84568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:03 devstack sudo[84568]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f9e692ec-d74f-47fb-965e-a6143d9af86a tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a 1G" returned: 0 in 0.718s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f9e692ec-d74f-47fb-965e-a6143d9af86a tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:03 devstack sudo[84580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a Apr 28 05:50:03 devstack sudo[84580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:03 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d023c07e-c7a2-4c82-91d5-d361641d7e83 tempest-GroupsV314Test-1957042941 None] Acquiring lock "cinder-quobyte-1914f78e-9421-4cd9-b741-dfeda8eaf9e8" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:03 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d023c07e-c7a2-4c82-91d5-d361641d7e83 tempest-GroupsV314Test-1957042941 None] Lock "cinder-quobyte-1914f78e-9421-4cd9-b741-dfeda8eaf9e8" acquired by "delete_volume" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:03 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7f21bd-39f7-4011-a871-5a65c3ace6fd]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d023c07e-c7a2-4c82-91d5-d361641d7e83 tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1914f78e-9421-4cd9-b741-dfeda8eaf9e8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:03 devstack sudo[84582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1914f78e-9421-4cd9-b741-dfeda8eaf9e8 Apr 28 05:50:03 devstack sudo[84582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:03 devstack sudo[84580]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f9e692ec-d74f-47fb-965e-a6143d9af86a tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a" returned: 0 in 0.515s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:03 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-f9e692ec-d74f-47fb-965e-a6143d9af86a tempest-SnapshotsActionsTest-1636782161 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a is being set with open permissions: ugo+rw Apr 28 05:50:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f9e692ec-d74f-47fb-965e-a6143d9af86a tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:03 devstack sudo[84587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a Apr 28 05:50:03 devstack sudo[84587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:03 devstack sudo[84582]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d023c07e-c7a2-4c82-91d5-d361641d7e83 tempest-GroupsV314Test-1957042941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1914f78e-9421-4cd9-b741-dfeda8eaf9e8" returned: 0 in 0.523s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d023c07e-c7a2-4c82-91d5-d361641d7e83 tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1914f78e-9421-4cd9-b741-dfeda8eaf9e8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:03 devstack sudo[84592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1914f78e-9421-4cd9-b741-dfeda8eaf9e8 Apr 28 05:50:03 devstack sudo[84592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:03 devstack sudo[84587]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f9e692ec-d74f-47fb-965e-a6143d9af86a tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a" returned: 0 in 0.442s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f9e692ec-d74f-47fb-965e-a6143d9af86a tempest-SnapshotsActionsTest-1636782161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.314s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5d2d30ff-04d7-4c71-bfb1-1f9e8896424e tempest-GroupSnapshotsV319Test-1031575877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.947s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:04 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-5d2d30ff-04d7-4c71-bfb1-1f9e8896424e tempest-GroupSnapshotsV319Test-1031575877 None] Creating offline snapshot 0caae76a-604e-4b9c-86f7-7746a7a44e89 of volume 72c32e94-6c4b-41eb-bbf0-480e9c6d59c5 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:50:04 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-f9e692ec-d74f-47fb-965e-a6143d9af86a tempest-SnapshotsActionsTest-1636782161 None] Create snapshot completed successfully Apr 28 05:50:04 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb6aec4-456c-456c-a5b4-5bd1957466bb]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5d2d30ff-04d7-4c71-bfb1-1f9e8896424e tempest-GroupSnapshotsV319Test-1031575877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:04 devstack sudo[84596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5 Apr 28 05:50:04 devstack sudo[84596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:04 devstack sudo[84592]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d023c07e-c7a2-4c82-91d5-d361641d7e83 tempest-GroupsV314Test-1957042941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1914f78e-9421-4cd9-b741-dfeda8eaf9e8" returned: 0 in 0.526s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d023c07e-c7a2-4c82-91d5-d361641d7e83 tempest-GroupsV314Test-1957042941 None] Lock "cinder-quobyte-1914f78e-9421-4cd9-b741-dfeda8eaf9e8" released by "delete_volume" :: held 1.097s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:04 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-d023c07e-c7a2-4c82-91d5-d361641d7e83 tempest-GroupsV314Test-1957042941 None] Created reservations ['a94c17ae-37c8-45b9-a8bd-d98bea75e789'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:50:04 devstack cinder-volume[81829]: WARNING cinder.quota [None req-d023c07e-c7a2-4c82-91d5-d361641d7e83 tempest-GroupsV314Test-1957042941 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-882050972 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-882050972, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:50:04 devstack cinder-volume[81829]: WARNING cinder.quota [None req-d023c07e-c7a2-4c82-91d5-d361641d7e83 tempest-GroupsV314Test-1957042941 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-882050972 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-882050972, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:50:04 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-d023c07e-c7a2-4c82-91d5-d361641d7e83 tempest-GroupsV314Test-1957042941 None] Created reservations ['cabd83c8-07d7-4730-8047-342c829d4d5f', '4e448dbe-8530-4904-b9e8-43100a103e37', 'f61d6d9f-c1f4-4a5a-8584-3daea6704680', '51c19a29-a595-4ab6-94e6-b0ad8877c969'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:50:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d023c07e-c7a2-4c82-91d5-d361641d7e83 tempest-GroupsV314Test-1957042941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d023c07e-c7a2-4c82-91d5-d361641d7e83 tempest-GroupsV314Test-1957042941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:04 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d023c07e-c7a2-4c82-91d5-d361641d7e83 tempest-GroupsV314Test-1957042941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:50:04 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d023c07e-c7a2-4c82-91d5-d361641d7e83 tempest-GroupsV314Test-1957042941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:50:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d023c07e-c7a2-4c82-91d5-d361641d7e83 tempest-GroupsV314Test-1957042941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d023c07e-c7a2-4c82-91d5-d361641d7e83 tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:04 devstack sudo[84598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:50:04 devstack sudo[84598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:04 devstack sudo[84596]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5d2d30ff-04d7-4c71-bfb1-1f9e8896424e tempest-GroupSnapshotsV319Test-1031575877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5" returned: 0 in 0.576s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5d2d30ff-04d7-4c71-bfb1-1f9e8896424e tempest-GroupSnapshotsV319Test-1031575877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.0caae76a-604e-4b9c-86f7-7746a7a44e89 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:04 devstack sudo[84605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.0caae76a-604e-4b9c-86f7-7746a7a44e89 1G Apr 28 05:50:04 devstack sudo[84605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:04 devstack sudo[84598]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d023c07e-c7a2-4c82-91d5-d361641d7e83 tempest-GroupsV314Test-1957042941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.462s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:04 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-d023c07e-c7a2-4c82-91d5-d361641d7e83 tempest-GroupsV314Test-1957042941 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:50:04 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-d023c07e-c7a2-4c82-91d5-d361641d7e83 tempest-GroupsV314Test-1957042941 None] Delete group completed successfully. Apr 28 05:50:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] Acquiring lock "cinder-2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] Acquiring lock "cinder-quobyte-be206168-e028-4825-8479-22034983745f" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-quobyte-be206168-e028-4825-8479-22034983745f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] Acquiring lock "cinder-quobyte-2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-quobyte-2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] Deleting offline snapshot 2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a of volume be206168-e028-4825-8479-22034983745f {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:50:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] snapshot_file for this snap is: volume-be206168-e028-4825-8479-22034983745f.2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:50:05 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f029667-a55e-4b57-a295-c4973b138326]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:05 devstack sudo[84610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a Apr 28 05:50:05 devstack sudo[84610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:05 devstack sudo[84605]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5d2d30ff-04d7-4c71-bfb1-1f9e8896424e tempest-GroupSnapshotsV319Test-1031575877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.0caae76a-604e-4b9c-86f7-7746a7a44e89 1G" returned: 0 in 0.673s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5d2d30ff-04d7-4c71-bfb1-1f9e8896424e tempest-GroupSnapshotsV319Test-1031575877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.0caae76a-604e-4b9c-86f7-7746a7a44e89 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:05 devstack sudo[84613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.0caae76a-604e-4b9c-86f7-7746a7a44e89 Apr 28 05:50:05 devstack sudo[84613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-bb71cc77-ce4b-42fe-a710-fc2ba9fab58d tempest-GroupsV314Test-1957042941 None] Acquiring lock "cinder-quobyte-c72cadd9-bb1e-4d59-b5e1-c275998bcf73" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-bb71cc77-ce4b-42fe-a710-fc2ba9fab58d tempest-GroupsV314Test-1957042941 None] Lock "cinder-quobyte-c72cadd9-bb1e-4d59-b5e1-c275998bcf73" acquired by "delete_volume" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:05 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93e1993-c33a-4bb1-a1ae-20a7bbbe949c]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-bb71cc77-ce4b-42fe-a710-fc2ba9fab58d tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:05 devstack sudo[84618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 Apr 28 05:50:05 devstack sudo[84618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:05 devstack sudo[84610]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a" returned: 0 in 0.601s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be206168-e028-4825-8479-22034983745f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:50:05 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6c2065-da53-48de-8f94-81269ba30b17]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:05 devstack sudo[84622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a Apr 28 05:50:05 devstack sudo[84622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:05 devstack sudo[84613]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5d2d30ff-04d7-4c71-bfb1-1f9e8896424e tempest-GroupSnapshotsV319Test-1031575877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.0caae76a-604e-4b9c-86f7-7746a7a44e89" returned: 0 in 0.506s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:05 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-5d2d30ff-04d7-4c71-bfb1-1f9e8896424e tempest-GroupSnapshotsV319Test-1031575877 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.0caae76a-604e-4b9c-86f7-7746a7a44e89 is being set with open permissions: ugo+rw: NotImplementedError Apr 28 05:50:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5d2d30ff-04d7-4c71-bfb1-1f9e8896424e tempest-GroupSnapshotsV319Test-1031575877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.0caae76a-604e-4b9c-86f7-7746a7a44e89 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:05 devstack sudo[84625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.0caae76a-604e-4b9c-86f7-7746a7a44e89 Apr 28 05:50:05 devstack sudo[84625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:06 devstack sudo[84618]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-bb71cc77-ce4b-42fe-a710-fc2ba9fab58d tempest-GroupsV314Test-1957042941 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73" returned: 0 in 0.554s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-bb71cc77-ce4b-42fe-a710-fc2ba9fab58d tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:06 devstack sudo[84630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73 Apr 28 05:50:06 devstack sudo[84630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:06 devstack sudo[84625]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5d2d30ff-04d7-4c71-bfb1-1f9e8896424e tempest-GroupSnapshotsV319Test-1031575877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.0caae76a-604e-4b9c-86f7-7746a7a44e89" returned: 0 in 0.461s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5d2d30ff-04d7-4c71-bfb1-1f9e8896424e tempest-GroupSnapshotsV319Test-1031575877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:06 devstack sudo[84622]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a" returned: 0 in 0.621s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be206168-e028-4825-8479-22034983745f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:50:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:06 devstack sudo[84636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.info Apr 28 05:50:06 devstack sudo[84636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:06 devstack sudo[84637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a Apr 28 05:50:06 devstack sudo[84637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:06 devstack sudo[84630]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-bb71cc77-ce4b-42fe-a710-fc2ba9fab58d tempest-GroupsV314Test-1957042941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c72cadd9-bb1e-4d59-b5e1-c275998bcf73" returned: 0 in 0.520s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:06 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-bb71cc77-ce4b-42fe-a710-fc2ba9fab58d tempest-GroupsV314Test-1957042941 None] Lock "cinder-quobyte-c72cadd9-bb1e-4d59-b5e1-c275998bcf73" released by "delete_volume" :: held 1.132s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:06 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-bb71cc77-ce4b-42fe-a710-fc2ba9fab58d tempest-GroupsV314Test-1957042941 None] Created reservations ['520a2816-08d1-4dec-afaf-f8b219f9ae5d'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:50:06 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-bb71cc77-ce4b-42fe-a710-fc2ba9fab58d tempest-GroupsV314Test-1957042941 None] Created reservations ['ad6d134a-0231-4905-a68f-e7335ffa9b95', '3d0cdc88-10fb-412b-bec8-0faec813fe37', '6acb4a39-ccc6-46bf-8d17-72bfe1ee1725', '137865ef-c2b8-4830-a5eb-9cdc3165a88e'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:50:06 devstack sudo[84636]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5d2d30ff-04d7-4c71-bfb1-1f9e8896424e tempest-GroupSnapshotsV319Test-1031575877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.info" returned: 0 in 0.515s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:06 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-5d2d30ff-04d7-4c71-bfb1-1f9e8896424e tempest-GroupSnapshotsV319Test-1031575877 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.info is being set with open permissions: ugo+rw: NotImplementedError Apr 28 05:50:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5d2d30ff-04d7-4c71-bfb1-1f9e8896424e tempest-GroupSnapshotsV319Test-1031575877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:06 devstack sudo[84645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.info Apr 28 05:50:06 devstack sudo[84645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:06 devstack cinder-volume[81829]: DEBUG oslo_service.periodic_task [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81829) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 05:50:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:50:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:50:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:06 devstack sudo[84647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:50:06 devstack sudo[84647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:07 devstack sudo[84637]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-bb71cc77-ce4b-42fe-a710-fc2ba9fab58d tempest-GroupsV314Test-1957042941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-bb71cc77-ce4b-42fe-a710-fc2ba9fab58d tempest-GroupsV314Test-1957042941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-bb71cc77-ce4b-42fe-a710-fc2ba9fab58d tempest-GroupsV314Test-1957042941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-bb71cc77-ce4b-42fe-a710-fc2ba9fab58d tempest-GroupsV314Test-1957042941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-bb71cc77-ce4b-42fe-a710-fc2ba9fab58d tempest-GroupsV314Test-1957042941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-bb71cc77-ce4b-42fe-a710-fc2ba9fab58d tempest-GroupsV314Test-1957042941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a" returned: 0 in 0.657s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:07 devstack sudo[84649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:50:07 devstack sudo[84649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:07 devstack sudo[84650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a Apr 28 05:50:07 devstack sudo[84650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:07 devstack sudo[84645]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5d2d30ff-04d7-4c71-bfb1-1f9e8896424e tempest-GroupSnapshotsV319Test-1031575877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.info" returned: 0 in 0.484s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5d2d30ff-04d7-4c71-bfb1-1f9e8896424e tempest-GroupSnapshotsV319Test-1031575877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.312s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-83cdf065-a932-4981-a602-0097a20fd402 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 17.179s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[43376c89-f548-4891-8bac-371d40fb437a]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-83cdf065-a932-4981-a602-0097a20fd402 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e442449-d92d-44f5-91a4-1645d5e95a7e {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:07 devstack sudo[84647]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.502s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:50:07 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-5d2d30ff-04d7-4c71-bfb1-1f9e8896424e tempest-GroupSnapshotsV319Test-1031575877 None] group_snapshot c750ff81-b4d3-41d5-aaba-becd7c24ad26: created successfully Apr 28 05:50:07 devstack sudo[84656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e442449-d92d-44f5-91a4-1645d5e95a7e Apr 28 05:50:07 devstack sudo[84656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:07 devstack sudo[84650]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a" returned: 0 in 0.496s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:07 devstack sudo[84649]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-bb71cc77-ce4b-42fe-a710-fc2ba9fab58d tempest-GroupsV314Test-1957042941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.531s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-bb71cc77-ce4b-42fe-a710-fc2ba9fab58d tempest-GroupsV314Test-1957042941 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-quobyte-2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a" released by "_delete_snapshot" :: held 2.484s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:07 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-bb71cc77-ce4b-42fe-a710-fc2ba9fab58d tempest-GroupsV314Test-1957042941 None] Delete group completed successfully. Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-quobyte-be206168-e028-4825-8479-22034983745f" released by "delete_snapshot" :: held 2.518s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:07 devstack cinder-volume[81829]: WARNING cinder.quota [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] Created reservations ['23072478-6f18-476a-a39d-ba2c30d8def6', 'a2765a55-b5fb-47a5-8fdf-0a03cc6cc6c7', 'f163d7df-cfcd-428e-accb-bb80c749f0fd', 'cd5d4085-833b-4f6c-b6c5-db3d668460f4'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:50:07 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] Delete snapshot completed successfully. Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-aa1bd2f1-2237-4ed0-8516-7a89263fb7e3 tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-2a2164e9-2ca2-4fc2-a020-4c4f25fb0e0a-delete_snapshot" released by "delete_snapshot" :: held 2.662s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:07 devstack sudo[84656]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-83cdf065-a932-4981-a602-0097a20fd402 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e442449-d92d-44f5-91a4-1645d5e95a7e" returned: 0 in 0.599s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-83cdf065-a932-4981-a602-0097a20fd402 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.616s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-83cdf065-a932-4981-a602-0097a20fd402 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381', 'name': 'volume-0e442449-d92d-44f5-91a4-1645d5e95a7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6e7783e2-966b-4075-894f-6620dbe56181', 'enforce_multipath': True} {{(pid=81829) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 28 05:50:08 devstack cinder-volume[81829]: INFO cinder.volume.manager [req-c6d1d0ac-8d9c-4dcc-b846-8491c50c448d req-83cdf065-a932-4981-a602-0097a20fd402 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] attachment_update completed successfully. Apr 28 05:50:08 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] group_snapshot c750ff81-b4d3-41d5-aaba-becd7c24ad26: deleting Apr 28 05:50:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] group_snapshot c750ff81-b4d3-41d5-aaba-becd7c24ad26: deleting {{(pid=81829) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 28 05:50:08 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] Acquiring lock "cinder-quobyte-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:08 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] Lock "cinder-quobyte-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:08 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] Acquiring lock "cinder-quobyte-0caae76a-604e-4b9c-86f7-7746a7a44e89" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:08 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] Lock "cinder-quobyte-0caae76a-604e-4b9c-86f7-7746a7a44e89" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] Deleting offline snapshot 0caae76a-604e-4b9c-86f7-7746a7a44e89 of volume 72c32e94-6c4b-41eb-bbf0-480e9c6d59c5 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:50:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] snapshot_file for this snap is: volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.0caae76a-604e-4b9c-86f7-7746a7a44e89 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:50:08 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd572d3-0b61-4257-9c3c-853561329ad4]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.0caae76a-604e-4b9c-86f7-7746a7a44e89 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e6281663-aee5-403a-8db1-f8b189908568 tempest-SnapshotsActionsTest-1636782161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e6281663-aee5-403a-8db1-f8b189908568 tempest-SnapshotsActionsTest-1636782161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-e6281663-aee5-403a-8db1-f8b189908568 tempest-SnapshotsActionsTest-1636782161 None] Creating offline snapshot 6ad5de7b-aa33-46b8-98e7-71d43156bc1b of volume be206168-e028-4825-8479-22034983745f {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:50:08 devstack sudo[84662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.0caae76a-604e-4b9c-86f7-7746a7a44e89 Apr 28 05:50:08 devstack sudo[84662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:08 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[128576c6-3e2f-4c0a-b503-a030d06de1d0]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e6281663-aee5-403a-8db1-f8b189908568 tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:08 devstack sudo[84666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a Apr 28 05:50:08 devstack sudo[84666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:09 devstack sudo[84662]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.0caae76a-604e-4b9c-86f7-7746a7a44e89" returned: 0 in 0.692s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:50:09 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[7783b4ac-9265-4d23-b36c-c212c0f73566]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:09 devstack sudo[84672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5 Apr 28 05:50:09 devstack sudo[84672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:09 devstack sudo[84666]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e6281663-aee5-403a-8db1-f8b189908568 tempest-SnapshotsActionsTest-1636782161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a" returned: 0 in 0.799s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-e6281663-aee5-403a-8db1-f8b189908568 tempest-SnapshotsActionsTest-1636782161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be206168-e028-4825-8479-22034983745f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:50:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e6281663-aee5-403a-8db1-f8b189908568 tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.6ad5de7b-aa33-46b8-98e7-71d43156bc1b 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:09 devstack sudo[84677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.6ad5de7b-aa33-46b8-98e7-71d43156bc1b 1G Apr 28 05:50:09 devstack sudo[84677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:09 devstack sudo[84672]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5" returned: 0 in 0.616s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.0caae76a-604e-4b9c-86f7-7746a7a44e89 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:09 devstack sudo[84682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.0caae76a-604e-4b9c-86f7-7746a7a44e89 Apr 28 05:50:09 devstack sudo[84682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:10 devstack sudo[84677]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e6281663-aee5-403a-8db1-f8b189908568 tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.6ad5de7b-aa33-46b8-98e7-71d43156bc1b 1G" returned: 0 in 0.826s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e6281663-aee5-403a-8db1-f8b189908568 tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.6ad5de7b-aa33-46b8-98e7-71d43156bc1b {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:10 devstack sudo[84754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.6ad5de7b-aa33-46b8-98e7-71d43156bc1b Apr 28 05:50:10 devstack sudo[84754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:10 devstack sudo[84682]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.0caae76a-604e-4b9c-86f7-7746a7a44e89" returned: 0 in 0.718s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.0caae76a-604e-4b9c-86f7-7746a7a44e89 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:10 devstack sudo[84759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.0caae76a-604e-4b9c-86f7-7746a7a44e89 Apr 28 05:50:10 devstack sudo[84759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:10 devstack sudo[84754]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e6281663-aee5-403a-8db1-f8b189908568 tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.6ad5de7b-aa33-46b8-98e7-71d43156bc1b" returned: 0 in 0.625s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:10 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-e6281663-aee5-403a-8db1-f8b189908568 tempest-SnapshotsActionsTest-1636782161 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.6ad5de7b-aa33-46b8-98e7-71d43156bc1b is being set with open permissions: ugo+rw Apr 28 05:50:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e6281663-aee5-403a-8db1-f8b189908568 tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.6ad5de7b-aa33-46b8-98e7-71d43156bc1b {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:10 devstack sudo[84765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.6ad5de7b-aa33-46b8-98e7-71d43156bc1b Apr 28 05:50:11 devstack sudo[84765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:11 devstack sudo[84759]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5.0caae76a-604e-4b9c-86f7-7746a7a44e89" returned: 0 in 0.518s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:11 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] Lock "cinder-quobyte-0caae76a-604e-4b9c-86f7-7746a7a44e89" released by "_delete_snapshot" :: held 2.654s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:11 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] Lock "cinder-quobyte-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5" released by "delete_snapshot" :: held 2.679s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:11 devstack cinder-volume[81829]: WARNING cinder.quota [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1719556524 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1719556524, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:50:11 devstack cinder-volume[81829]: WARNING cinder.quota [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1719556524 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1719556524, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:50:11 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] Created reservations ['63167afc-bc0b-4bd5-93ba-8901e22d747c', 'c95f3e61-f744-4d06-8163-4c6e9ddef0ec', 'ae920bdb-f07c-4454-bac0-12abc446103c', '6c6d8e12-3207-43bd-94d9-6a34da563413'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:50:11 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-192c7465-39b5-4f22-bff8-60c93eceb4a9 tempest-GroupSnapshotsV319Test-1031575877 None] group_snapshot c750ff81-b4d3-41d5-aaba-becd7c24ad26: deleted successfully Apr 28 05:50:11 devstack sudo[84765]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e6281663-aee5-403a-8db1-f8b189908568 tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.6ad5de7b-aa33-46b8-98e7-71d43156bc1b" returned: 0 in 0.527s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e6281663-aee5-403a-8db1-f8b189908568 tempest-SnapshotsActionsTest-1636782161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.893s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:11 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-e6281663-aee5-403a-8db1-f8b189908568 tempest-SnapshotsActionsTest-1636782161 None] Create snapshot completed successfully Apr 28 05:50:11 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] Acquiring lock "cinder-6ad5de7b-aa33-46b8-98e7-71d43156bc1b-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:11 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-6ad5de7b-aa33-46b8-98e7-71d43156bc1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:11 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] Acquiring lock "cinder-quobyte-be206168-e028-4825-8479-22034983745f" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:11 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-quobyte-be206168-e028-4825-8479-22034983745f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:11 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] Acquiring lock "cinder-quobyte-6ad5de7b-aa33-46b8-98e7-71d43156bc1b" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:11 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-quobyte-6ad5de7b-aa33-46b8-98e7-71d43156bc1b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:11 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] Deleting offline snapshot 6ad5de7b-aa33-46b8-98e7-71d43156bc1b of volume be206168-e028-4825-8479-22034983745f {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:50:11 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] snapshot_file for this snap is: volume-be206168-e028-4825-8479-22034983745f.6ad5de7b-aa33-46b8-98e7-71d43156bc1b {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:50:11 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fc2872-8afe-406e-8781-568402a41281]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.6ad5de7b-aa33-46b8-98e7-71d43156bc1b {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:12 devstack sudo[84772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.6ad5de7b-aa33-46b8-98e7-71d43156bc1b Apr 28 05:50:12 devstack sudo[84772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:12 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c14bcd8c-eece-4bf5-8d87-500f39e01f60 tempest-GroupSnapshotsV319Test-1031575877 None] Acquiring lock "cinder-quobyte-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:12 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c14bcd8c-eece-4bf5-8d87-500f39e01f60 tempest-GroupSnapshotsV319Test-1031575877 None] Lock "cinder-quobyte-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5" acquired by "delete_volume" :: waited 0.029s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:12 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b8dcb5-fb7c-420f-b01c-758f2fd460d4]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c14bcd8c-eece-4bf5-8d87-500f39e01f60 tempest-GroupSnapshotsV319Test-1031575877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:12 devstack sudo[84774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5 Apr 28 05:50:12 devstack sudo[84774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:12 devstack sudo[84772]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.6ad5de7b-aa33-46b8-98e7-71d43156bc1b" returned: 0 in 0.694s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:12 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be206168-e028-4825-8479-22034983745f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:50:12 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6beb428-f1fe-404b-8bf5-cd3b061c3697]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:12 devstack sudo[84781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a Apr 28 05:50:12 devstack sudo[84781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:12 devstack sudo[84774]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c14bcd8c-eece-4bf5-8d87-500f39e01f60 tempest-GroupSnapshotsV319Test-1031575877 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5" returned: 0 in 0.628s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c14bcd8c-eece-4bf5-8d87-500f39e01f60 tempest-GroupSnapshotsV319Test-1031575877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:12 devstack sudo[84785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5 Apr 28 05:50:12 devstack sudo[84785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:13 devstack sudo[84781]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a" returned: 0 in 0.704s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:13 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be206168-e028-4825-8479-22034983745f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:50:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.6ad5de7b-aa33-46b8-98e7-71d43156bc1b {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:13 devstack sudo[85110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.6ad5de7b-aa33-46b8-98e7-71d43156bc1b Apr 28 05:50:13 devstack sudo[85110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:13 devstack sudo[84785]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c14bcd8c-eece-4bf5-8d87-500f39e01f60 tempest-GroupSnapshotsV319Test-1031575877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5" returned: 0 in 0.618s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:13 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c14bcd8c-eece-4bf5-8d87-500f39e01f60 tempest-GroupSnapshotsV319Test-1031575877 None] Lock "cinder-quobyte-72c32e94-6c4b-41eb-bbf0-480e9c6d59c5" released by "delete_volume" :: held 1.320s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:13 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-c14bcd8c-eece-4bf5-8d87-500f39e01f60 tempest-GroupSnapshotsV319Test-1031575877 None] Created reservations ['21a2c9f3-152c-443c-96fe-df48710af2a5'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:50:13 devstack cinder-volume[81829]: WARNING cinder.quota [None req-c14bcd8c-eece-4bf5-8d87-500f39e01f60 tempest-GroupSnapshotsV319Test-1031575877 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1719556524 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1719556524, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:50:13 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-c14bcd8c-eece-4bf5-8d87-500f39e01f60 tempest-GroupSnapshotsV319Test-1031575877 None] Created reservations ['f62abc13-3f85-4243-9d97-96df8880cdf3', 'a6800c1c-52d1-42a2-9117-2f62c860d39d', '767413d5-92c3-40e6-8dfd-96b73f3ee4ae', 'b66cdd24-6353-4a9f-91c0-daeabbd1ec44'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:50:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c14bcd8c-eece-4bf5-8d87-500f39e01f60 tempest-GroupSnapshotsV319Test-1031575877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c14bcd8c-eece-4bf5-8d87-500f39e01f60 tempest-GroupSnapshotsV319Test-1031575877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:13 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c14bcd8c-eece-4bf5-8d87-500f39e01f60 tempest-GroupSnapshotsV319Test-1031575877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:50:13 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c14bcd8c-eece-4bf5-8d87-500f39e01f60 tempest-GroupSnapshotsV319Test-1031575877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:50:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c14bcd8c-eece-4bf5-8d87-500f39e01f60 tempest-GroupSnapshotsV319Test-1031575877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c14bcd8c-eece-4bf5-8d87-500f39e01f60 tempest-GroupSnapshotsV319Test-1031575877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:13 devstack sudo[85116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:50:13 devstack sudo[85116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:14 devstack sudo[85110]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.6ad5de7b-aa33-46b8-98e7-71d43156bc1b" returned: 0 in 0.722s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.6ad5de7b-aa33-46b8-98e7-71d43156bc1b {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:14 devstack sudo[85125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.6ad5de7b-aa33-46b8-98e7-71d43156bc1b Apr 28 05:50:14 devstack sudo[85125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:14 devstack sudo[85116]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c14bcd8c-eece-4bf5-8d87-500f39e01f60 tempest-GroupSnapshotsV319Test-1031575877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.658s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:14 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-c14bcd8c-eece-4bf5-8d87-500f39e01f60 tempest-GroupSnapshotsV319Test-1031575877 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:50:14 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-c14bcd8c-eece-4bf5-8d87-500f39e01f60 tempest-GroupSnapshotsV319Test-1031575877 None] Delete group completed successfully. Apr 28 05:50:14 devstack sudo[85125]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.6ad5de7b-aa33-46b8-98e7-71d43156bc1b" returned: 0 in 0.690s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:14 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-quobyte-6ad5de7b-aa33-46b8-98e7-71d43156bc1b" released by "_delete_snapshot" :: held 2.939s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:14 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-quobyte-be206168-e028-4825-8479-22034983745f" released by "delete_snapshot" :: held 2.971s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:14 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] Created reservations ['34047825-081f-436d-8b43-801fe44a8ff7', '26116d6f-7edd-4bba-86bd-8352f87e41d3', 'cc62d7b2-2092-40c0-85d1-ba3616ac2f0a', '7ac4a8ea-b4b0-4896-ae45-5db8ebd9734a'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:50:15 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] Delete snapshot completed successfully. Apr 28 05:50:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-833dd424-d5d3-4357-bc08-ce402286d463 tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-6ad5de7b-aa33-46b8-98e7-71d43156bc1b-delete_snapshot" released by "delete_snapshot" :: held 3.320s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6623321b-0086-4bd2-a327-f85a52858b44 tempest-SnapshotsActionsTest-1636782161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6623321b-0086-4bd2-a327-f85a52858b44 tempest-SnapshotsActionsTest-1636782161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-6623321b-0086-4bd2-a327-f85a52858b44 tempest-SnapshotsActionsTest-1636782161 None] Creating offline snapshot 5a0218d1-084a-4d1b-9dca-397cefbf5c21 of volume be206168-e028-4825-8479-22034983745f {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:50:16 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7be893-f114-4b7a-ae3a-573ed3c66250]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6623321b-0086-4bd2-a327-f85a52858b44 tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:16 devstack sudo[85161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a Apr 28 05:50:16 devstack sudo[85161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:17 devstack sudo[85161]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6623321b-0086-4bd2-a327-f85a52858b44 tempest-SnapshotsActionsTest-1636782161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a" returned: 0 in 0.740s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:17 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-6623321b-0086-4bd2-a327-f85a52858b44 tempest-SnapshotsActionsTest-1636782161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be206168-e028-4825-8479-22034983745f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:50:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6623321b-0086-4bd2-a327-f85a52858b44 tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.5a0218d1-084a-4d1b-9dca-397cefbf5c21 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:17 devstack sudo[85167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.5a0218d1-084a-4d1b-9dca-397cefbf5c21 1G Apr 28 05:50:17 devstack sudo[85167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:18 devstack sudo[85167]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6623321b-0086-4bd2-a327-f85a52858b44 tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.5a0218d1-084a-4d1b-9dca-397cefbf5c21 1G" returned: 0 in 0.930s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6623321b-0086-4bd2-a327-f85a52858b44 tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.5a0218d1-084a-4d1b-9dca-397cefbf5c21 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:18 devstack sudo[85204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.5a0218d1-084a-4d1b-9dca-397cefbf5c21 Apr 28 05:50:18 devstack sudo[85204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:19 devstack sudo[85204]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6623321b-0086-4bd2-a327-f85a52858b44 tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.5a0218d1-084a-4d1b-9dca-397cefbf5c21" returned: 0 in 0.786s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:19 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-6623321b-0086-4bd2-a327-f85a52858b44 tempest-SnapshotsActionsTest-1636782161 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.5a0218d1-084a-4d1b-9dca-397cefbf5c21 is being set with open permissions: ugo+rw Apr 28 05:50:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6623321b-0086-4bd2-a327-f85a52858b44 tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.5a0218d1-084a-4d1b-9dca-397cefbf5c21 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:19 devstack sudo[85211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.5a0218d1-084a-4d1b-9dca-397cefbf5c21 Apr 28 05:50:19 devstack sudo[85211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:19 devstack sudo[85211]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6623321b-0086-4bd2-a327-f85a52858b44 tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.5a0218d1-084a-4d1b-9dca-397cefbf5c21" returned: 0 in 0.535s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6623321b-0086-4bd2-a327-f85a52858b44 tempest-SnapshotsActionsTest-1636782161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.114s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:19 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:UPDATE=149,cinder:SELECT=119,cinder:INSERT=29,cinder:DELETE=7 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:50:19 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-6623321b-0086-4bd2-a327-f85a52858b44 tempest-SnapshotsActionsTest-1636782161 None] Create snapshot completed successfully Apr 28 05:50:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] Acquiring lock "cinder-5a0218d1-084a-4d1b-9dca-397cefbf5c21-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-5a0218d1-084a-4d1b-9dca-397cefbf5c21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] Acquiring lock "cinder-quobyte-be206168-e028-4825-8479-22034983745f" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-quobyte-be206168-e028-4825-8479-22034983745f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] Acquiring lock "cinder-quobyte-5a0218d1-084a-4d1b-9dca-397cefbf5c21" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-quobyte-5a0218d1-084a-4d1b-9dca-397cefbf5c21" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] Deleting offline snapshot 5a0218d1-084a-4d1b-9dca-397cefbf5c21 of volume be206168-e028-4825-8479-22034983745f {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:50:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] snapshot_file for this snap is: volume-be206168-e028-4825-8479-22034983745f.5a0218d1-084a-4d1b-9dca-397cefbf5c21 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:50:20 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[8451052b-5493-4a41-a35a-c1092c3aca7f]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.5a0218d1-084a-4d1b-9dca-397cefbf5c21 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:21 devstack sudo[85216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.5a0218d1-084a-4d1b-9dca-397cefbf5c21 Apr 28 05:50:21 devstack sudo[85216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Flow 'volume_create_manager' (73961852-650b-4692-8971-8c50299544e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeccf61f-3f98-4a2d-acea-2769968091a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeccf61f-3f98-4a2d-acea-2769968091a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1173357747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3540581-95ab-45aa-82c1-d073d77cabf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b228a05119f24890bdfc02208d546b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:50:21Z,use_quota=True,user_id='6cbcfeeb1a244c49b5378fa14f4b3374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff3c848-b09d-45f5-9ce5-82cbf18632bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff3c848-b09d-45f5-9ce5-82cbf18632bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd06f84c-2ec6-49f1-b728-efae8a4839fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd06f84c-2ec6-49f1-b728-efae8a4839fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3540581-95ab-45aa-82c1-d073d77cabf1', 'volume_name': 'volume-d3540581-95ab-45aa-82c1-d073d77cabf1', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd237261-dff2-4780-a529-6fd4b33a7a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd237261-dff2-4780-a529-6fd4b33a7a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a1f064-39b8-40f3-816c-ce4ed15fafce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:21 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Volume d3540581-95ab-45aa-82c1-d073d77cabf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3540581-95ab-45aa-82c1-d073d77cabf1', 'volume_size': 1} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1173357747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3540581-95ab-45aa-82c1-d073d77cabf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b228a05119f24890bdfc02208d546b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:50:21Z,use_quota=True,user_id='6cbcfeeb1a244c49b5378fa14f4b3374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Creating volume d3540581-95ab-45aa-82c1-d073d77cabf1 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:50:21 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3540581-95ab-45aa-82c1-d073d77cabf1 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:21 devstack sudo[85218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3540581-95ab-45aa-82c1-d073d77cabf1 1073741824 Apr 28 05:50:21 devstack sudo[85218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:21 devstack sudo[85216]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.5a0218d1-084a-4d1b-9dca-397cefbf5c21" returned: 0 in 0.742s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be206168-e028-4825-8479-22034983745f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[e867a8b7-1500-422c-841c-014c1c84a050]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:21 devstack sudo[85223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a Apr 28 05:50:21 devstack sudo[85223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:22 devstack sudo[85218]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3540581-95ab-45aa-82c1-d073d77cabf1 1073741824" returned: 0 in 0.776s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3540581-95ab-45aa-82c1-d073d77cabf1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:22 devstack sudo[85228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3540581-95ab-45aa-82c1-d073d77cabf1 Apr 28 05:50:22 devstack sudo[85228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:22 devstack sudo[85223]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a" returned: 0 in 0.670s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be206168-e028-4825-8479-22034983745f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:50:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.5a0218d1-084a-4d1b-9dca-397cefbf5c21 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:22 devstack sudo[85233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.5a0218d1-084a-4d1b-9dca-397cefbf5c21 Apr 28 05:50:22 devstack sudo[85233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:22 devstack sudo[85228]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3540581-95ab-45aa-82c1-d073d77cabf1" returned: 0 in 0.655s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:50:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a1f064-39b8-40f3-816c-ce4ed15fafce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3540581-95ab-45aa-82c1-d073d77cabf1', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4bf20d9-6b2a-405c-a10e-64fdc6773575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:22 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Volume volume-d3540581-95ab-45aa-82c1-d073d77cabf1 (d3540581-95ab-45aa-82c1-d073d77cabf1): created successfully Apr 28 05:50:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4bf20d9-6b2a-405c-a10e-64fdc6773575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Flow 'volume_create_manager' (73961852-650b-4692-8971-8c50299544e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:50:22 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-42d5a192-75fc-474e-8507-48ce89a66646 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Created volume successfully. Apr 28 05:50:23 devstack sudo[85233]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.5a0218d1-084a-4d1b-9dca-397cefbf5c21" returned: 0 in 0.677s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.5a0218d1-084a-4d1b-9dca-397cefbf5c21 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:23 devstack sudo[85239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.5a0218d1-084a-4d1b-9dca-397cefbf5c21 Apr 28 05:50:23 devstack sudo[85239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:23 devstack sudo[85239]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.5a0218d1-084a-4d1b-9dca-397cefbf5c21" returned: 0 in 0.747s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-quobyte-5a0218d1-084a-4d1b-9dca-397cefbf5c21" released by "_delete_snapshot" :: held 2.999s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-quobyte-be206168-e028-4825-8479-22034983745f" released by "delete_snapshot" :: held 3.022s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:23 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] Created reservations ['e8c8a8e9-e41c-41c3-b078-732deb3e2839', '0724bf30-c58c-4bf1-888d-666e24080349', '3079f845-cdf8-4d2a-93f2-c3aaf2ae3671', '6022a668-f830-44c0-a982-8bc89c3494d3'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:50:24 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] Delete snapshot completed successfully. Apr 28 05:50:24 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-212cde2e-30f7-4d34-b260-7d989e21d2c9 tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-5a0218d1-084a-4d1b-9dca-397cefbf5c21-delete_snapshot" released by "delete_snapshot" :: held 3.284s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:24 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5f8afdd0-1123-4520-a033-5c92085724f2 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Acquiring lock "cinder-d3540581-95ab-45aa-82c1-d073d77cabf1-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:24 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5f8afdd0-1123-4520-a033-5c92085724f2 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Lock "cinder-d3540581-95ab-45aa-82c1-d073d77cabf1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:24 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5f8afdd0-1123-4520-a033-5c92085724f2 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Acquiring lock "cinder-quobyte-d3540581-95ab-45aa-82c1-d073d77cabf1" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:24 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5f8afdd0-1123-4520-a033-5c92085724f2 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Lock "cinder-quobyte-d3540581-95ab-45aa-82c1-d073d77cabf1" acquired by "delete_volume" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:24 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[66adfef0-4858-4143-beaf-e616b130d4f7]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5f8afdd0-1123-4520-a033-5c92085724f2 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3540581-95ab-45aa-82c1-d073d77cabf1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:24 devstack sudo[85269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3540581-95ab-45aa-82c1-d073d77cabf1 Apr 28 05:50:24 devstack sudo[85269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5535f8ad-657f-4e71-8739-1e6c3fc91ff0 tempest-SnapshotsActionsTest-1636782161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5535f8ad-657f-4e71-8739-1e6c3fc91ff0 tempest-SnapshotsActionsTest-1636782161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-5535f8ad-657f-4e71-8739-1e6c3fc91ff0 tempest-SnapshotsActionsTest-1636782161 None] Creating offline snapshot 89263eed-645b-4af8-9368-6fd89e371cb3 of volume be206168-e028-4825-8479-22034983745f {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:50:25 devstack sudo[85269]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5f8afdd0-1123-4520-a033-5c92085724f2 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3540581-95ab-45aa-82c1-d073d77cabf1" returned: 0 in 0.832s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5f8afdd0-1123-4520-a033-5c92085724f2 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3540581-95ab-45aa-82c1-d073d77cabf1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:25 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65a7d25-eb7d-4c7f-aea3-d3f5046db9e7]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5535f8ad-657f-4e71-8739-1e6c3fc91ff0 tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:25 devstack sudo[85274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3540581-95ab-45aa-82c1-d073d77cabf1 Apr 28 05:50:25 devstack sudo[85274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:25 devstack sudo[85275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a Apr 28 05:50:25 devstack sudo[85275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:26 devstack sudo[85274]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5f8afdd0-1123-4520-a033-5c92085724f2 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3540581-95ab-45aa-82c1-d073d77cabf1" returned: 0 in 0.537s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5f8afdd0-1123-4520-a033-5c92085724f2 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Lock "cinder-quobyte-d3540581-95ab-45aa-82c1-d073d77cabf1" released by "delete_volume" :: held 1.418s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:26 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-5f8afdd0-1123-4520-a033-5c92085724f2 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Created reservations ['485ca2fa-4986-4745-8d2e-a96be929a2f4', '32552ae1-8cbc-4907-b88e-dbe69d80107e', '56241b29-74cd-4376-a69e-64b071dea3a1', '778a73cf-fe97-4b7f-a856-d8977caab430'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:50:26 devstack sudo[85275]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5535f8ad-657f-4e71-8739-1e6c3fc91ff0 tempest-SnapshotsActionsTest-1636782161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a" returned: 0 in 0.669s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-5535f8ad-657f-4e71-8739-1e6c3fc91ff0 tempest-SnapshotsActionsTest-1636782161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be206168-e028-4825-8479-22034983745f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:50:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5535f8ad-657f-4e71-8739-1e6c3fc91ff0 tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.89263eed-645b-4af8-9368-6fd89e371cb3 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:26 devstack sudo[85300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.89263eed-645b-4af8-9368-6fd89e371cb3 1G Apr 28 05:50:26 devstack sudo[85300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5f8afdd0-1123-4520-a033-5c92085724f2 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5f8afdd0-1123-4520-a033-5c92085724f2 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5f8afdd0-1123-4520-a033-5c92085724f2 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:50:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5f8afdd0-1123-4520-a033-5c92085724f2 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:50:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5f8afdd0-1123-4520-a033-5c92085724f2 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5f8afdd0-1123-4520-a033-5c92085724f2 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:26 devstack sudo[85302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:50:26 devstack sudo[85302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:26 devstack sudo[85302]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5f8afdd0-1123-4520-a033-5c92085724f2 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.521s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:26 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-5f8afdd0-1123-4520-a033-5c92085724f2 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:50:26 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-5f8afdd0-1123-4520-a033-5c92085724f2 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Deleted volume successfully. Apr 28 05:50:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5f8afdd0-1123-4520-a033-5c92085724f2 tempest-VolumeQuotasNegativeTestJSON-2107647036 None] Lock "cinder-d3540581-95ab-45aa-82c1-d073d77cabf1-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:27 devstack sudo[85300]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5535f8ad-657f-4e71-8739-1e6c3fc91ff0 tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.89263eed-645b-4af8-9368-6fd89e371cb3 1G" returned: 0 in 0.839s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5535f8ad-657f-4e71-8739-1e6c3fc91ff0 tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.89263eed-645b-4af8-9368-6fd89e371cb3 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:27 devstack sudo[85308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.89263eed-645b-4af8-9368-6fd89e371cb3 Apr 28 05:50:27 devstack sudo[85308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:27 devstack sudo[85308]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5535f8ad-657f-4e71-8739-1e6c3fc91ff0 tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.89263eed-645b-4af8-9368-6fd89e371cb3" returned: 0 in 0.568s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:27 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-5535f8ad-657f-4e71-8739-1e6c3fc91ff0 tempest-SnapshotsActionsTest-1636782161 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.89263eed-645b-4af8-9368-6fd89e371cb3 is being set with open permissions: ugo+rw Apr 28 05:50:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5535f8ad-657f-4e71-8739-1e6c3fc91ff0 tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.89263eed-645b-4af8-9368-6fd89e371cb3 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:27 devstack sudo[85313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.89263eed-645b-4af8-9368-6fd89e371cb3 Apr 28 05:50:27 devstack sudo[85313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:28 devstack sudo[85313]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5535f8ad-657f-4e71-8739-1e6c3fc91ff0 tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.89263eed-645b-4af8-9368-6fd89e371cb3" returned: 0 in 0.523s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5535f8ad-657f-4e71-8739-1e6c3fc91ff0 tempest-SnapshotsActionsTest-1636782161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.713s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:28 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-5535f8ad-657f-4e71-8739-1e6c3fc91ff0 tempest-SnapshotsActionsTest-1636782161 None] Create snapshot completed successfully Apr 28 05:50:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] Acquiring lock "cinder-89263eed-645b-4af8-9368-6fd89e371cb3-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-89263eed-645b-4af8-9368-6fd89e371cb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] Acquiring lock "cinder-quobyte-be206168-e028-4825-8479-22034983745f" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-quobyte-be206168-e028-4825-8479-22034983745f" acquired by "delete_snapshot" :: waited 0.035s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] Acquiring lock "cinder-quobyte-89263eed-645b-4af8-9368-6fd89e371cb3" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-quobyte-89263eed-645b-4af8-9368-6fd89e371cb3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] Deleting offline snapshot 89263eed-645b-4af8-9368-6fd89e371cb3 of volume be206168-e028-4825-8479-22034983745f {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:50:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] snapshot_file for this snap is: volume-be206168-e028-4825-8479-22034983745f.89263eed-645b-4af8-9368-6fd89e371cb3 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:50:28 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c7a560-37d0-42f5-81e8-8cfc6d1a56af]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.89263eed-645b-4af8-9368-6fd89e371cb3 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:29 devstack sudo[85318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.89263eed-645b-4af8-9368-6fd89e371cb3 Apr 28 05:50:29 devstack sudo[85318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:29 devstack sudo[85318]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.89263eed-645b-4af8-9368-6fd89e371cb3" returned: 0 in 0.674s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be206168-e028-4825-8479-22034983745f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:50:29 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f83fd6-bd38-4855-82b7-51154a5c8b07]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:29 devstack sudo[85323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a Apr 28 05:50:29 devstack sudo[85323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:30 devstack sudo[85323]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a" returned: 0 in 0.632s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be206168-e028-4825-8479-22034983745f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:50:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.89263eed-645b-4af8-9368-6fd89e371cb3 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:30 devstack sudo[85352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.89263eed-645b-4af8-9368-6fd89e371cb3 Apr 28 05:50:30 devstack sudo[85352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:31 devstack sudo[85352]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.89263eed-645b-4af8-9368-6fd89e371cb3" returned: 0 in 0.740s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.89263eed-645b-4af8-9368-6fd89e371cb3 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:31 devstack sudo[85364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.89263eed-645b-4af8-9368-6fd89e371cb3 Apr 28 05:50:31 devstack sudo[85364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:31 devstack sudo[85364]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.89263eed-645b-4af8-9368-6fd89e371cb3" returned: 0 in 0.664s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:31 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-quobyte-89263eed-645b-4af8-9368-6fd89e371cb3" released by "_delete_snapshot" :: held 2.825s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:31 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-quobyte-be206168-e028-4825-8479-22034983745f" released by "delete_snapshot" :: held 2.857s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:31 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] Created reservations ['c243ee58-00f4-45cf-804e-c3a62d1992b5', 'b7d59819-d7d3-400b-a51a-247b71a2c04e', '8a5cb47a-cd65-40e7-af72-c7c75224792c', '63bacafd-9936-4619-a056-2b15df55fba6'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:50:31 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] Delete snapshot completed successfully. Apr 28 05:50:32 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d5be4872-fcaa-4c22-9759-ef4b41bf3a2a tempest-SnapshotsActionsTest-684843535 None] Lock "cinder-89263eed-645b-4af8-9368-6fd89e371cb3-delete_snapshot" released by "delete_snapshot" :: held 3.143s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:32 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-b7a108e5-51d0-43bd-811b-9db9e704fde7 tempest-GroupsTest-2114451673 None] Group tempest-Group1-1748724977: creating Apr 28 05:50:32 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-b7a108e5-51d0-43bd-811b-9db9e704fde7 tempest-GroupsTest-2114451673 None] Group tempest-Group1-1748724977: created successfully Apr 28 05:50:32 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-b7a108e5-51d0-43bd-811b-9db9e704fde7 tempest-GroupsTest-2114451673 None] Create group completed successfully. Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-49fdd42b-cc41-42d8-9c75-66430346e1f5 tempest-SnapshotsActionsTest-1636782161 None] Acquiring lock "cinder-219cfc86-bfad-4968-89e4-a1b22faefb6a-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-49fdd42b-cc41-42d8-9c75-66430346e1f5 tempest-SnapshotsActionsTest-1636782161 None] Lock "cinder-219cfc86-bfad-4968-89e4-a1b22faefb6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-49fdd42b-cc41-42d8-9c75-66430346e1f5 tempest-SnapshotsActionsTest-1636782161 None] Acquiring lock "cinder-quobyte-be206168-e028-4825-8479-22034983745f" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-49fdd42b-cc41-42d8-9c75-66430346e1f5 tempest-SnapshotsActionsTest-1636782161 None] Lock "cinder-quobyte-be206168-e028-4825-8479-22034983745f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-49fdd42b-cc41-42d8-9c75-66430346e1f5 tempest-SnapshotsActionsTest-1636782161 None] Acquiring lock "cinder-quobyte-219cfc86-bfad-4968-89e4-a1b22faefb6a" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-49fdd42b-cc41-42d8-9c75-66430346e1f5 tempest-SnapshotsActionsTest-1636782161 None] Lock "cinder-quobyte-219cfc86-bfad-4968-89e4-a1b22faefb6a" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-49fdd42b-cc41-42d8-9c75-66430346e1f5 tempest-SnapshotsActionsTest-1636782161 None] Deleting offline snapshot 219cfc86-bfad-4968-89e4-a1b22faefb6a of volume be206168-e028-4825-8479-22034983745f {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-49fdd42b-cc41-42d8-9c75-66430346e1f5 tempest-SnapshotsActionsTest-1636782161 None] snapshot_file for this snap is: volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[0279405e-1ee2-4306-8927-6dcf5a193ab3]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-49fdd42b-cc41-42d8-9c75-66430346e1f5 tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:33 devstack sudo[85411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a Apr 28 05:50:33 devstack sudo[85411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Flow 'volume_create_manager' (7ae3f916-92db-4f5f-a40e-d0827948ddaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022a4ca2-4021-4f0f-901f-4d9fa95bdeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022a4ca2-4021-4f0f-901f-4d9fa95bdeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1420424559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc46986f-a013-4d36-ac6f-fddfff7ab2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e41914d26534bb49cfb1e79bea3d3ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:50:34Z,use_quota=True,user_id='523792fedf2b4c0783799db3a5266a69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ae88ed-0c07-432a-b753-128245a67e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ae88ed-0c07-432a-b753-128245a67e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a65fd6-0ebc-425d-9357-3daed97808cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a65fd6-0ebc-425d-9357-3daed97808cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc46986f-a013-4d36-ac6f-fddfff7ab2cb', 'volume_name': 'volume-cc46986f-a013-4d36-ac6f-fddfff7ab2cb', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da910f3e-598f-4c66-a042-55b9986338ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da910f3e-598f-4c66-a042-55b9986338ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241384ec-6e39-4a59-af1d-5cd0bca14178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:33 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Volume cc46986f-a013-4d36-ac6f-fddfff7ab2cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc46986f-a013-4d36-ac6f-fddfff7ab2cb', 'volume_size': 1} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1420424559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc46986f-a013-4d36-ac6f-fddfff7ab2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e41914d26534bb49cfb1e79bea3d3ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:50:34Z,use_quota=True,user_id='523792fedf2b4c0783799db3a5266a69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Creating volume cc46986f-a013-4d36-ac6f-fddfff7ab2cb {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:50:33 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:50:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cc46986f-a013-4d36-ac6f-fddfff7ab2cb 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:33 devstack sudo[85413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cc46986f-a013-4d36-ac6f-fddfff7ab2cb 1073741824 Apr 28 05:50:33 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:34 devstack sudo[85411]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-49fdd42b-cc41-42d8-9c75-66430346e1f5 tempest-SnapshotsActionsTest-1636782161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a" returned: 0 in 0.900s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:34 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-49fdd42b-cc41-42d8-9c75-66430346e1f5 tempest-SnapshotsActionsTest-1636782161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be206168-e028-4825-8479-22034983745f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:50:34 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dea1829-e277-4825-8f7e-f522a845b08e]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-49fdd42b-cc41-42d8-9c75-66430346e1f5 tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:34 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-be52c2c5-5163-4732-8d12-8d4096fe7b77 tempest-GroupsTest-2114451673 None] Group tempest-Group2-1169963654: creating Apr 28 05:50:34 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-be52c2c5-5163-4732-8d12-8d4096fe7b77 tempest-GroupsTest-2114451673 None] Group tempest-Group2-1169963654: created successfully Apr 28 05:50:34 devstack sudo[85421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f Apr 28 05:50:34 devstack sudo[85421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:34 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-be52c2c5-5163-4732-8d12-8d4096fe7b77 tempest-GroupsTest-2114451673 None] Create group completed successfully. Apr 28 05:50:34 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cc46986f-a013-4d36-ac6f-fddfff7ab2cb 1073741824" returned: 0 in 1.070s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cc46986f-a013-4d36-ac6f-fddfff7ab2cb {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:34 devstack sudo[85425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cc46986f-a013-4d36-ac6f-fddfff7ab2cb Apr 28 05:50:34 devstack sudo[85425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:35 devstack sudo[85421]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-49fdd42b-cc41-42d8-9c75-66430346e1f5 tempest-SnapshotsActionsTest-1636782161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f" returned: 0 in 0.889s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-49fdd42b-cc41-42d8-9c75-66430346e1f5 tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:35 devstack sudo[85430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a Apr 28 05:50:35 devstack sudo[85430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:35 devstack sudo[85425]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cc46986f-a013-4d36-ac6f-fddfff7ab2cb" returned: 0 in 0.564s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:35 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:50:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:35 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241384ec-6e39-4a59-af1d-5cd0bca14178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc46986f-a013-4d36-ac6f-fddfff7ab2cb', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:35 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44e50e2-1aa8-4649-a2f4-184e437474c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:35 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Volume volume-cc46986f-a013-4d36-ac6f-fddfff7ab2cb (cc46986f-a013-4d36-ac6f-fddfff7ab2cb): created successfully Apr 28 05:50:35 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44e50e2-1aa8-4649-a2f4-184e437474c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:35 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Flow 'volume_create_manager' (7ae3f916-92db-4f5f-a40e-d0827948ddaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:50:35 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-dcf5ed93-a948-48e1-8c72-3150a10813c0 tempest-VolumesServicesTestJSON-1488580190 None] Created volume successfully. Apr 28 05:50:35 devstack sudo[85430]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-49fdd42b-cc41-42d8-9c75-66430346e1f5 tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a" returned: 0 in 0.875s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-49fdd42b-cc41-42d8-9c75-66430346e1f5 tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:35 devstack sudo[85444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a Apr 28 05:50:35 devstack sudo[85444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Flow 'volume_create_manager' (562068e2-3642-47fd-a992-fc5d0464ffc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0733151e-a72b-43fe-92ed-b50405349278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0733151e-a72b-43fe-92ed-b50405349278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1809508752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4e635c68-2859-4780-84ae-5e6a27bcaef7,host='devstack@QuobyteHD#QuobyteHD',id=2276971b-9a2f-4d63-8f58-8f2529685e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f60805675d40729ed04f62049da5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:50:36Z,use_quota=True,user_id='5e6c361cfc49470eb8993f4eea2f99ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10426112-fa13-4c03-a1b9-656b405c399f),volume_type_id=10426112-fa13-4c03-a1b9-656b405c399f)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fae8794-f7e8-4f1f-8ea9-6c8176bf9ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fae8794-f7e8-4f1f-8ea9-6c8176bf9ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7432a5-21f4-47ef-9a39-c534cd5e05f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad7432a5-21f4-47ef-9a39-c534cd5e05f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2276971b-9a2f-4d63-8f58-8f2529685e71', 'volume_name': 'volume-2276971b-9a2f-4d63-8f58-8f2529685e71', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be87efb-a36f-44ff-9798-2f3ed7691483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be87efb-a36f-44ff-9798-2f3ed7691483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aadef99b-8c92-4e33-9b54-b26d89fecdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:36 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Volume 2276971b-9a2f-4d63-8f58-8f2529685e71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2276971b-9a2f-4d63-8f58-8f2529685e71', 'volume_size': 1} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4e635c68-2859-4780-84ae-5e6a27bcaef7,created_at=2026-04-28T03:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1809508752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4e635c68-2859-4780-84ae-5e6a27bcaef7,host='devstack@QuobyteHD#QuobyteHD',id=2276971b-9a2f-4d63-8f58-8f2529685e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f60805675d40729ed04f62049da5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:50:36Z,use_quota=True,user_id='5e6c361cfc49470eb8993f4eea2f99ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10426112-fa13-4c03-a1b9-656b405c399f),volume_type_id=10426112-fa13-4c03-a1b9-656b405c399f)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Creating volume 2276971b-9a2f-4d63-8f58-8f2529685e71 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:50:36 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2276971b-9a2f-4d63-8f58-8f2529685e71 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4c82ce81-34d8-4ba0-9899-adff2d00e5f5 tempest-VolumesServicesTestJSON-1488580190 None] Acquiring lock "cinder-cc46986f-a013-4d36-ac6f-fddfff7ab2cb-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:36 devstack sudo[85446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2276971b-9a2f-4d63-8f58-8f2529685e71 1073741824 Apr 28 05:50:36 devstack sudo[85446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4c82ce81-34d8-4ba0-9899-adff2d00e5f5 tempest-VolumesServicesTestJSON-1488580190 None] Lock "cinder-cc46986f-a013-4d36-ac6f-fddfff7ab2cb-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4c82ce81-34d8-4ba0-9899-adff2d00e5f5 tempest-VolumesServicesTestJSON-1488580190 None] Acquiring lock "cinder-quobyte-cc46986f-a013-4d36-ac6f-fddfff7ab2cb" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4c82ce81-34d8-4ba0-9899-adff2d00e5f5 tempest-VolumesServicesTestJSON-1488580190 None] Lock "cinder-quobyte-cc46986f-a013-4d36-ac6f-fddfff7ab2cb" acquired by "delete_volume" :: waited 0.023s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca6240d-b64b-461d-8ece-bc1bc2f539da]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4c82ce81-34d8-4ba0-9899-adff2d00e5f5 tempest-VolumesServicesTestJSON-1488580190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cc46986f-a013-4d36-ac6f-fddfff7ab2cb {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:36 devstack sudo[85448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cc46986f-a013-4d36-ac6f-fddfff7ab2cb Apr 28 05:50:36 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:36 devstack sudo[85444]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-49fdd42b-cc41-42d8-9c75-66430346e1f5 tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f.219cfc86-bfad-4968-89e4-a1b22faefb6a" returned: 0 in 0.713s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-49fdd42b-cc41-42d8-9c75-66430346e1f5 tempest-SnapshotsActionsTest-1636782161 None] Lock "cinder-quobyte-219cfc86-bfad-4968-89e4-a1b22faefb6a" released by "_delete_snapshot" :: held 3.515s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-49fdd42b-cc41-42d8-9c75-66430346e1f5 tempest-SnapshotsActionsTest-1636782161 None] Lock "cinder-quobyte-be206168-e028-4825-8479-22034983745f" released by "delete_snapshot" :: held 3.559s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-49fdd42b-cc41-42d8-9c75-66430346e1f5 tempest-SnapshotsActionsTest-1636782161 None] Created reservations ['96cada64-18f3-4661-a97c-c78127b79665', 'a91cfb4d-0e2c-4c1c-b45a-1789715f2c69', 'e36bb794-e9ca-489c-b24c-f37f6434ac29', 'b7e61277-778f-491b-8d9c-ed5f8c2d80a8'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:50:36 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-49fdd42b-cc41-42d8-9c75-66430346e1f5 tempest-SnapshotsActionsTest-1636782161 None] Delete snapshot completed successfully. Apr 28 05:50:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-49fdd42b-cc41-42d8-9c75-66430346e1f5 tempest-SnapshotsActionsTest-1636782161 None] Lock "cinder-219cfc86-bfad-4968-89e4-a1b22faefb6a-delete_snapshot" released by "delete_snapshot" :: held 3.716s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:37 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4c82ce81-34d8-4ba0-9899-adff2d00e5f5 tempest-VolumesServicesTestJSON-1488580190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cc46986f-a013-4d36-ac6f-fddfff7ab2cb" returned: 0 in 0.607s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4c82ce81-34d8-4ba0-9899-adff2d00e5f5 tempest-VolumesServicesTestJSON-1488580190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cc46986f-a013-4d36-ac6f-fddfff7ab2cb {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:37 devstack sudo[85446]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2276971b-9a2f-4d63-8f58-8f2529685e71 1073741824" returned: 0 in 0.854s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:37 devstack sudo[85457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cc46986f-a013-4d36-ac6f-fddfff7ab2cb Apr 28 05:50:37 devstack sudo[85457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2276971b-9a2f-4d63-8f58-8f2529685e71 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:37 devstack sudo[85459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2276971b-9a2f-4d63-8f58-8f2529685e71 Apr 28 05:50:37 devstack sudo[85459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-74b0a29b-697c-4c97-a75f-f0245af47e63 tempest-SnapshotsActionsTest-1636782161 None] Acquiring lock "cinder-be206168-e028-4825-8479-22034983745f-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-74b0a29b-697c-4c97-a75f-f0245af47e63 tempest-SnapshotsActionsTest-1636782161 None] Lock "cinder-be206168-e028-4825-8479-22034983745f-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-74b0a29b-697c-4c97-a75f-f0245af47e63 tempest-SnapshotsActionsTest-1636782161 None] Acquiring lock "cinder-quobyte-be206168-e028-4825-8479-22034983745f" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-74b0a29b-697c-4c97-a75f-f0245af47e63 tempest-SnapshotsActionsTest-1636782161 None] Lock "cinder-quobyte-be206168-e028-4825-8479-22034983745f" acquired by "delete_volume" :: waited 0.025s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:37 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[669204b7-244b-49e4-b165-3d4b470fd9f6]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-74b0a29b-697c-4c97-a75f-f0245af47e63 tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:37 devstack sudo[85459]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2276971b-9a2f-4d63-8f58-8f2529685e71" returned: 0 in 0.692s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:37 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:50:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:37 devstack sudo[85457]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4c82ce81-34d8-4ba0-9899-adff2d00e5f5 tempest-VolumesServicesTestJSON-1488580190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cc46986f-a013-4d36-ac6f-fddfff7ab2cb" returned: 0 in 0.749s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aadef99b-8c92-4e33-9b54-b26d89fecdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2276971b-9a2f-4d63-8f58-8f2529685e71', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3c899f-3693-4e77-b929-ecc2b69e34c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:37 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Volume volume-2276971b-9a2f-4d63-8f58-8f2529685e71 (2276971b-9a2f-4d63-8f58-8f2529685e71): created successfully Apr 28 05:50:37 devstack sudo[85472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f Apr 28 05:50:37 devstack sudo[85472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3c899f-3693-4e77-b929-ecc2b69e34c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Flow 'volume_create_manager' (562068e2-3642-47fd-a992-fc5d0464ffc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:50:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4c82ce81-34d8-4ba0-9899-adff2d00e5f5 tempest-VolumesServicesTestJSON-1488580190 None] Lock "cinder-quobyte-cc46986f-a013-4d36-ac6f-fddfff7ab2cb" released by "delete_volume" :: held 1.465s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:37 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-3afea5d2-6362-4cae-b1ac-0a2a219f4c22 tempest-GroupsTest-2114451673 None] Created volume successfully. Apr 28 05:50:38 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-4c82ce81-34d8-4ba0-9899-adff2d00e5f5 tempest-VolumesServicesTestJSON-1488580190 None] Created reservations ['79b7d64b-876c-4b2b-8c01-e6ac722553c1', '58f6ff14-e39d-400f-b35b-4dfe612e3ada', '17c9ea66-cb3f-4a4a-bf41-f44619560390', '95139332-5a18-48f7-83ee-19e022767050'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:50:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4c82ce81-34d8-4ba0-9899-adff2d00e5f5 tempest-VolumesServicesTestJSON-1488580190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4c82ce81-34d8-4ba0-9899-adff2d00e5f5 tempest-VolumesServicesTestJSON-1488580190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:38 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4c82ce81-34d8-4ba0-9899-adff2d00e5f5 tempest-VolumesServicesTestJSON-1488580190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:50:38 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4c82ce81-34d8-4ba0-9899-adff2d00e5f5 tempest-VolumesServicesTestJSON-1488580190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:50:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4c82ce81-34d8-4ba0-9899-adff2d00e5f5 tempest-VolumesServicesTestJSON-1488580190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4c82ce81-34d8-4ba0-9899-adff2d00e5f5 tempest-VolumesServicesTestJSON-1488580190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:38 devstack sudo[85495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:50:38 devstack sudo[85495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:38 devstack sudo[85472]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-74b0a29b-697c-4c97-a75f-f0245af47e63 tempest-SnapshotsActionsTest-1636782161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f" returned: 0 in 0.863s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-74b0a29b-697c-4c97-a75f-f0245af47e63 tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:38 devstack sudo[85503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f Apr 28 05:50:38 devstack sudo[85503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:38 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-582b5f63-de77-4c6a-9aca-ea42b9896395 tempest-GroupsTest-2114451673 None] Acquiring lock "cinder-quobyte-2276971b-9a2f-4d63-8f58-8f2529685e71" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:38 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-582b5f63-de77-4c6a-9aca-ea42b9896395 tempest-GroupsTest-2114451673 None] Lock "cinder-quobyte-2276971b-9a2f-4d63-8f58-8f2529685e71" acquired by "delete_volume" :: waited 0.025s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:38 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[993d707b-5959-4a0f-9972-b36e491140f2]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-582b5f63-de77-4c6a-9aca-ea42b9896395 tempest-GroupsTest-2114451673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2276971b-9a2f-4d63-8f58-8f2529685e71 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:38 devstack sudo[85495]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4c82ce81-34d8-4ba0-9899-adff2d00e5f5 tempest-VolumesServicesTestJSON-1488580190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.744s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:38 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-4c82ce81-34d8-4ba0-9899-adff2d00e5f5 tempest-VolumesServicesTestJSON-1488580190 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:50:38 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-4c82ce81-34d8-4ba0-9899-adff2d00e5f5 tempest-VolumesServicesTestJSON-1488580190 None] Deleted volume successfully. Apr 28 05:50:38 devstack sudo[85508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2276971b-9a2f-4d63-8f58-8f2529685e71 Apr 28 05:50:38 devstack sudo[85508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:38 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4c82ce81-34d8-4ba0-9899-adff2d00e5f5 tempest-VolumesServicesTestJSON-1488580190 None] Lock "cinder-cc46986f-a013-4d36-ac6f-fddfff7ab2cb-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:39 devstack sudo[85503]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-74b0a29b-697c-4c97-a75f-f0245af47e63 tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-be206168-e028-4825-8479-22034983745f" returned: 0 in 0.819s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:39 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-74b0a29b-697c-4c97-a75f-f0245af47e63 tempest-SnapshotsActionsTest-1636782161 None] Lock "cinder-quobyte-be206168-e028-4825-8479-22034983745f" released by "delete_volume" :: held 1.757s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:39 devstack sudo[85508]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:39 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-74b0a29b-697c-4c97-a75f-f0245af47e63 tempest-SnapshotsActionsTest-1636782161 None] Created reservations ['e6b8a829-7192-4bbe-a76e-80e515318438', '98ea27f8-9072-49dc-a281-7ee732643bbf', 'c4b31726-7bbd-4913-b9e9-40febfdb0f29', 'aa4e7812-fc24-4a4c-8f04-084e85176a8d'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:50:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-582b5f63-de77-4c6a-9aca-ea42b9896395 tempest-GroupsTest-2114451673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2276971b-9a2f-4d63-8f58-8f2529685e71" returned: 0 in 0.774s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-582b5f63-de77-4c6a-9aca-ea42b9896395 tempest-GroupsTest-2114451673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2276971b-9a2f-4d63-8f58-8f2529685e71 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:39 devstack sudo[85521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2276971b-9a2f-4d63-8f58-8f2529685e71 Apr 28 05:50:39 devstack sudo[85521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-74b0a29b-697c-4c97-a75f-f0245af47e63 tempest-SnapshotsActionsTest-1636782161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-74b0a29b-697c-4c97-a75f-f0245af47e63 tempest-SnapshotsActionsTest-1636782161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:39 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-74b0a29b-697c-4c97-a75f-f0245af47e63 tempest-SnapshotsActionsTest-1636782161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:50:39 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-74b0a29b-697c-4c97-a75f-f0245af47e63 tempest-SnapshotsActionsTest-1636782161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:50:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-74b0a29b-697c-4c97-a75f-f0245af47e63 tempest-SnapshotsActionsTest-1636782161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-74b0a29b-697c-4c97-a75f-f0245af47e63 tempest-SnapshotsActionsTest-1636782161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:39 devstack sudo[85523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:50:39 devstack sudo[85523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:40 devstack sudo[85521]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-582b5f63-de77-4c6a-9aca-ea42b9896395 tempest-GroupsTest-2114451673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2276971b-9a2f-4d63-8f58-8f2529685e71" returned: 0 in 0.732s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-582b5f63-de77-4c6a-9aca-ea42b9896395 tempest-GroupsTest-2114451673 None] Lock "cinder-quobyte-2276971b-9a2f-4d63-8f58-8f2529685e71" released by "delete_volume" :: held 1.576s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:40 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-582b5f63-de77-4c6a-9aca-ea42b9896395 tempest-GroupsTest-2114451673 None] Created reservations ['2ebc3afd-ad47-4c98-8123-7e1053fa5540'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:50:40 devstack sudo[85523]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-74b0a29b-697c-4c97-a75f-f0245af47e63 tempest-SnapshotsActionsTest-1636782161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.864s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:40 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-74b0a29b-697c-4c97-a75f-f0245af47e63 tempest-SnapshotsActionsTest-1636782161 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:50:40 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-74b0a29b-697c-4c97-a75f-f0245af47e63 tempest-SnapshotsActionsTest-1636782161 None] Deleted volume successfully. Apr 28 05:50:40 devstack cinder-volume[81829]: WARNING cinder.quota [None req-582b5f63-de77-4c6a-9aca-ea42b9896395 tempest-GroupsTest-2114451673 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-416207828 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-416207828, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:50:40 devstack cinder-volume[81829]: WARNING cinder.quota [None req-582b5f63-de77-4c6a-9aca-ea42b9896395 tempest-GroupsTest-2114451673 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-416207828 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-416207828, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:50:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-74b0a29b-697c-4c97-a75f-f0245af47e63 tempest-SnapshotsActionsTest-1636782161 None] Lock "cinder-be206168-e028-4825-8479-22034983745f-delete_volume" released by "delete_volume" :: held 2.950s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:40 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-582b5f63-de77-4c6a-9aca-ea42b9896395 tempest-GroupsTest-2114451673 None] Created reservations ['3a1093c0-f9aa-43f9-a260-943a53f6c4f1', '03572acc-e373-42fc-a94a-87b8cfb0e473', '3d1d7156-0093-48f7-8fa9-7fde0bba4891', '99e3d66b-dcc3-45aa-afea-f63f438d2544'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:50:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-582b5f63-de77-4c6a-9aca-ea42b9896395 tempest-GroupsTest-2114451673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-582b5f63-de77-4c6a-9aca-ea42b9896395 tempest-GroupsTest-2114451673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-582b5f63-de77-4c6a-9aca-ea42b9896395 tempest-GroupsTest-2114451673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:50:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-582b5f63-de77-4c6a-9aca-ea42b9896395 tempest-GroupsTest-2114451673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:50:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-582b5f63-de77-4c6a-9aca-ea42b9896395 tempest-GroupsTest-2114451673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-582b5f63-de77-4c6a-9aca-ea42b9896395 tempest-GroupsTest-2114451673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:40 devstack sudo[85562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:50:40 devstack sudo[85562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:41 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-139876cc-8d3f-448f-ac0e-5edaf3291c5f tempest-GroupsTest-2114451673 None] Created reservations ['92ab4fd1-9093-4d85-95ca-c8297b997d14'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:50:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-139876cc-8d3f-448f-ac0e-5edaf3291c5f tempest-GroupsTest-2114451673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-139876cc-8d3f-448f-ac0e-5edaf3291c5f tempest-GroupsTest-2114451673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:41 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-139876cc-8d3f-448f-ac0e-5edaf3291c5f tempest-GroupsTest-2114451673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:50:41 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-139876cc-8d3f-448f-ac0e-5edaf3291c5f tempest-GroupsTest-2114451673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:50:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-139876cc-8d3f-448f-ac0e-5edaf3291c5f tempest-GroupsTest-2114451673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-139876cc-8d3f-448f-ac0e-5edaf3291c5f tempest-GroupsTest-2114451673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:41 devstack sudo[85565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:50:41 devstack sudo[85565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:41 devstack sudo[85562]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-582b5f63-de77-4c6a-9aca-ea42b9896395 tempest-GroupsTest-2114451673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 1.140s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:41 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-582b5f63-de77-4c6a-9aca-ea42b9896395 tempest-GroupsTest-2114451673 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:50:41 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-582b5f63-de77-4c6a-9aca-ea42b9896395 tempest-GroupsTest-2114451673 None] Delete group completed successfully. Apr 28 05:50:42 devstack sudo[85565]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-139876cc-8d3f-448f-ac0e-5edaf3291c5f tempest-GroupsTest-2114451673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.821s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:42 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-139876cc-8d3f-448f-ac0e-5edaf3291c5f tempest-GroupsTest-2114451673 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:50:42 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-139876cc-8d3f-448f-ac0e-5edaf3291c5f tempest-GroupsTest-2114451673 None] Delete group completed successfully. Apr 28 05:50:43 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-5837f681-74b2-4cae-a18f-1656b3743e50 tempest-GroupsTest-2114451673 None] Group tempest-GroupsTest-Group-1107692552: creating Apr 28 05:50:43 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-5837f681-74b2-4cae-a18f-1656b3743e50 tempest-GroupsTest-2114451673 None] Group tempest-GroupsTest-Group-1107692552: created successfully Apr 28 05:50:43 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-5837f681-74b2-4cae-a18f-1656b3743e50 tempest-GroupsTest-2114451673 None] Create group completed successfully. Apr 28 05:50:44 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:50:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Flow 'volume_create_manager' (6f4ca7ea-eeaf-4fc7-8ec9-7dbd5f826bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:50:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eb65f2e-0e6e-4c2a-b00a-79a2dd79506b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eb65f2e-0e6e-4c2a-b00a-79a2dd79506b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1330577722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e08d3a9f-9494-4f55-a699-7778917b367c,host='devstack@QuobyteHD#QuobyteHD',id=4dea8001-47ac-4b28-b3ae-bd96635ea655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f60805675d40729ed04f62049da5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:50:45Z,use_quota=True,user_id='5e6c361cfc49470eb8993f4eea2f99ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7203162-fa66-4b18-b654-6a3a7cafd970),volume_type_id=b7203162-fa66-4b18-b654-6a3a7cafd970)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef56c97-5dbb-4c11-a6a7-c526f7bee06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef56c97-5dbb-4c11-a6a7-c526f7bee06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f3075a-9428-4243-9bbd-cfdf1a3cf1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f3075a-9428-4243-9bbd-cfdf1a3cf1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dea8001-47ac-4b28-b3ae-bd96635ea655', 'volume_name': 'volume-4dea8001-47ac-4b28-b3ae-bd96635ea655', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4757be-f68c-4fb3-8fd2-cb36ee19a70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4757be-f68c-4fb3-8fd2-cb36ee19a70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22b0d6d-a12c-4fcf-948c-c2842021fbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:44 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Volume 4dea8001-47ac-4b28-b3ae-bd96635ea655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dea8001-47ac-4b28-b3ae-bd96635ea655', 'volume_size': 1} Apr 28 05:50:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e08d3a9f-9494-4f55-a699-7778917b367c,created_at=2026-04-28T03:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1330577722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e08d3a9f-9494-4f55-a699-7778917b367c,host='devstack@QuobyteHD#QuobyteHD',id=4dea8001-47ac-4b28-b3ae-bd96635ea655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f60805675d40729ed04f62049da5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:50:45Z,use_quota=True,user_id='5e6c361cfc49470eb8993f4eea2f99ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7203162-fa66-4b18-b654-6a3a7cafd970),volume_type_id=b7203162-fa66-4b18-b654-6a3a7cafd970)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:50:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Creating volume 4dea8001-47ac-4b28-b3ae-bd96635ea655 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:50:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:50:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:50:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:50:44 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:50:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4dea8001-47ac-4b28-b3ae-bd96635ea655 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:44 devstack sudo[85576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4dea8001-47ac-4b28-b3ae-bd96635ea655 1073741824 Apr 28 05:50:44 devstack sudo[85576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:45 devstack sudo[85576]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4dea8001-47ac-4b28-b3ae-bd96635ea655 1073741824" returned: 0 in 0.750s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4dea8001-47ac-4b28-b3ae-bd96635ea655 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:45 devstack sudo[85581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4dea8001-47ac-4b28-b3ae-bd96635ea655 Apr 28 05:50:45 devstack sudo[85581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:46 devstack sudo[85581]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4dea8001-47ac-4b28-b3ae-bd96635ea655" returned: 0 in 0.557s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:46 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:50:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22b0d6d-a12c-4fcf-948c-c2842021fbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dea8001-47ac-4b28-b3ae-bd96635ea655', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa28c4d6-f11e-4726-96d6-ac3c553c8833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:46 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Volume volume-4dea8001-47ac-4b28-b3ae-bd96635ea655 (4dea8001-47ac-4b28-b3ae-bd96635ea655): created successfully Apr 28 05:50:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa28c4d6-f11e-4726-96d6-ac3c553c8833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Flow 'volume_create_manager' (6f4ca7ea-eeaf-4fc7-8ec9-7dbd5f826bdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:50:46 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-ab7e8311-26db-492a-b19c-fd1be83f72ea tempest-GroupsTest-2114451673 None] Created volume successfully. Apr 28 05:50:47 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:50:47 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Flow 'volume_create_manager' (d73a4af2-fcb5-42f2-ac2f-c312751e862f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:50:47 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f76a53c3-b09a-4c2b-b3e2-14765ae5e9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:47 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f76a53c3-b09a-4c2b-b3e2-14765ae5e9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1558770879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e08d3a9f-9494-4f55-a699-7778917b367c,host='devstack@QuobyteHD#QuobyteHD',id=96337d29-842a-4231-90a6-94b34495c58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f60805675d40729ed04f62049da5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:50:47Z,use_quota=True,user_id='5e6c361cfc49470eb8993f4eea2f99ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7203162-fa66-4b18-b654-6a3a7cafd970),volume_type_id=b7203162-fa66-4b18-b654-6a3a7cafd970)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:47 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f32f76b3-3390-473d-89e5-54184ca941df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:47 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f32f76b3-3390-473d-89e5-54184ca941df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:47 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbbced68-0e70-496d-8759-fae2af625c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:47 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbbced68-0e70-496d-8759-fae2af625c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96337d29-842a-4231-90a6-94b34495c58b', 'volume_name': 'volume-96337d29-842a-4231-90a6-94b34495c58b', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:47 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21900fee-02ef-45f1-92a5-3a52b30fe4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:47 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21900fee-02ef-45f1-92a5-3a52b30fe4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:47 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (061ec5a3-2ef8-4d74-b8fd-0eb88c633309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:47 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Volume 96337d29-842a-4231-90a6-94b34495c58b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96337d29-842a-4231-90a6-94b34495c58b', 'volume_size': 1} Apr 28 05:50:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:47 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e08d3a9f-9494-4f55-a699-7778917b367c,created_at=2026-04-28T03:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1558770879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e08d3a9f-9494-4f55-a699-7778917b367c,host='devstack@QuobyteHD#QuobyteHD',id=96337d29-842a-4231-90a6-94b34495c58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f60805675d40729ed04f62049da5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:50:47Z,use_quota=True,user_id='5e6c361cfc49470eb8993f4eea2f99ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7203162-fa66-4b18-b654-6a3a7cafd970),volume_type_id=b7203162-fa66-4b18-b654-6a3a7cafd970)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:50:47 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Creating volume 96337d29-842a-4231-90a6-94b34495c58b {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:50:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:47 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:50:47 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:50:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:47 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:50:47 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:50:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-96337d29-842a-4231-90a6-94b34495c58b 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:47 devstack sudo[85585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-96337d29-842a-4231-90a6-94b34495c58b 1073741824 Apr 28 05:50:47 devstack sudo[85585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:48 devstack sudo[85585]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-96337d29-842a-4231-90a6-94b34495c58b 1073741824" returned: 0 in 0.897s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-96337d29-842a-4231-90a6-94b34495c58b {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:48 devstack sudo[85590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-96337d29-842a-4231-90a6-94b34495c58b Apr 28 05:50:48 devstack sudo[85590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:49 devstack sudo[85590]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-96337d29-842a-4231-90a6-94b34495c58b" returned: 0 in 0.690s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:49 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:50:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:49 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (061ec5a3-2ef8-4d74-b8fd-0eb88c633309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96337d29-842a-4231-90a6-94b34495c58b', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:49 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff565976-f569-417c-bd68-f300cf68c863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:49 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Volume volume-96337d29-842a-4231-90a6-94b34495c58b (96337d29-842a-4231-90a6-94b34495c58b): created successfully Apr 28 05:50:49 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff565976-f569-417c-bd68-f300cf68c863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:49 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Flow 'volume_create_manager' (d73a4af2-fcb5-42f2-ac2f-c312751e862f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:50:49 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-269dd60a-b81b-43a1-aed9-d9264faac08f tempest-GroupsTest-2114451673 None] Created volume successfully. Apr 28 05:50:49 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-82d331c4-4e1c-4647-9f98-419d17863841 tempest-GroupsTest-2114451673 None] Update group completed successfully. Apr 28 05:50:51 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-12e7c3f5-fe4c-4593-bbf6-ffb4a6d9c5f4 tempest-GroupsTest-2114451673 None] Update group completed successfully. Apr 28 05:50:51 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:50:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Flow 'volume_create_manager' (b04a0083-546f-4e4b-879d-430561e654e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:50:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5b1813-5917-4860-9ddd-e2cb7dfe47e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5b1813-5917-4860-9ddd-e2cb7dfe47e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-599709697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2846edb8-8c33-41e9-8897-9369b033f735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb908defdb9944d3ac9b9750a39732f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:50:51Z,use_quota=True,user_id='e95e84c15bc0432c8cf2137dda57f5cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cae0a8f-8d34-4ca4-9a0a-1904d49b54bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cae0a8f-8d34-4ca4-9a0a-1904d49b54bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c359e845-3b3c-4746-94e4-a4e7b5565e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c359e845-3b3c-4746-94e4-a4e7b5565e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2846edb8-8c33-41e9-8897-9369b033f735', 'volume_name': 'volume-2846edb8-8c33-41e9-8897-9369b033f735', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141353e7-1f02-4a4e-9b3f-55fa4086e3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141353e7-1f02-4a4e-9b3f-55fa4086e3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33a326b-70fb-405d-9899-062fd5c3a421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:51 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Volume 2846edb8-8c33-41e9-8897-9369b033f735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2846edb8-8c33-41e9-8897-9369b033f735', 'volume_size': 1} Apr 28 05:50:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-599709697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2846edb8-8c33-41e9-8897-9369b033f735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb908defdb9944d3ac9b9750a39732f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:50:51Z,use_quota=True,user_id='e95e84c15bc0432c8cf2137dda57f5cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:50:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Creating volume 2846edb8-8c33-41e9-8897-9369b033f735 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:50:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:50:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:50:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:50:51 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:50:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2846edb8-8c33-41e9-8897-9369b033f735 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:51 devstack sudo[85611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2846edb8-8c33-41e9-8897-9369b033f735 1073741824 Apr 28 05:50:51 devstack sudo[85611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:52 devstack sudo[85611]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2846edb8-8c33-41e9-8897-9369b033f735 1073741824" returned: 0 in 0.700s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2846edb8-8c33-41e9-8897-9369b033f735 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:52 devstack sudo[85622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2846edb8-8c33-41e9-8897-9369b033f735 Apr 28 05:50:52 devstack sudo[85622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:52 devstack sudo[85622]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2846edb8-8c33-41e9-8897-9369b033f735" returned: 0 in 0.633s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:50:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33a326b-70fb-405d-9899-062fd5c3a421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2846edb8-8c33-41e9-8897-9369b033f735', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00efb6b-7102-4661-88c1-69c12bb83b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:52 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Volume volume-2846edb8-8c33-41e9-8897-9369b033f735 (2846edb8-8c33-41e9-8897-9369b033f735): created successfully Apr 28 05:50:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d00efb6b-7102-4661-88c1-69c12bb83b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Flow 'volume_create_manager' (b04a0083-546f-4e4b-879d-430561e654e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:50:52 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-f6a31046-bad5-4144-8643-f3a822e34d5a tempest-VolumesListAdminTestJSON-994234865 None] Created volume successfully. Apr 28 05:50:53 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Acquiring lock "cinder-quobyte-4dea8001-47ac-4b28-b3ae-bd96635ea655" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:53 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Lock "cinder-quobyte-4dea8001-47ac-4b28-b3ae-bd96635ea655" acquired by "delete_volume" :: waited 0.027s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:53 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7301ad-0929-4566-9620-778f495252d2]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4dea8001-47ac-4b28-b3ae-bd96635ea655 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:53 devstack sudo[85625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4dea8001-47ac-4b28-b3ae-bd96635ea655 Apr 28 05:50:53 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:53 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4dea8001-47ac-4b28-b3ae-bd96635ea655" returned: 0 in 0.665s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4dea8001-47ac-4b28-b3ae-bd96635ea655 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:53 devstack sudo[85630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4dea8001-47ac-4b28-b3ae-bd96635ea655 Apr 28 05:50:53 devstack sudo[85630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Flow 'volume_create_manager' (8fb07161-beba-4905-becf-622d0c6970f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e574736-550f-43fe-8adb-fdae914f6e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e574736-550f-43fe-8adb-fdae914f6e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1227619846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24444d91-0fc4-4c58-a81e-50c1b3aadb97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb908defdb9944d3ac9b9750a39732f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:50:54Z,use_quota=True,user_id='e95e84c15bc0432c8cf2137dda57f5cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf08767-5a19-43cb-8d96-fc55474035a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf08767-5a19-43cb-8d96-fc55474035a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec9f220-fe40-4885-a9cd-06169bf3fade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec9f220-fe40-4885-a9cd-06169bf3fade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24444d91-0fc4-4c58-a81e-50c1b3aadb97', 'volume_name': 'volume-24444d91-0fc4-4c58-a81e-50c1b3aadb97', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01c9cacf-3497-4ad8-86e2-250f23b082b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01c9cacf-3497-4ad8-86e2-250f23b082b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16262f9d-474e-47a0-8fca-d63943ba3539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:54 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Volume 24444d91-0fc4-4c58-a81e-50c1b3aadb97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24444d91-0fc4-4c58-a81e-50c1b3aadb97', 'volume_size': 1} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1227619846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24444d91-0fc4-4c58-a81e-50c1b3aadb97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb908defdb9944d3ac9b9750a39732f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:50:54Z,use_quota=True,user_id='e95e84c15bc0432c8cf2137dda57f5cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Creating volume 24444d91-0fc4-4c58-a81e-50c1b3aadb97 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:50:54 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-24444d91-0fc4-4c58-a81e-50c1b3aadb97 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:54 devstack sudo[85636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-24444d91-0fc4-4c58-a81e-50c1b3aadb97 1073741824 Apr 28 05:50:54 devstack sudo[85636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:54 devstack sudo[85630]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4dea8001-47ac-4b28-b3ae-bd96635ea655" returned: 0 in 0.620s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Lock "cinder-quobyte-4dea8001-47ac-4b28-b3ae-bd96635ea655" released by "delete_volume" :: held 1.339s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Acquiring lock "cinder-quobyte-96337d29-842a-4231-90a6-94b34495c58b" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Lock "cinder-quobyte-96337d29-842a-4231-90a6-94b34495c58b" acquired by "delete_volume" :: waited 0.012s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1b730e-b2f9-48ac-958f-13fa0d840efc]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-96337d29-842a-4231-90a6-94b34495c58b {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:54 devstack sudo[85639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-96337d29-842a-4231-90a6-94b34495c58b Apr 28 05:50:54 devstack sudo[85639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:54 devstack sudo[85636]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-24444d91-0fc4-4c58-a81e-50c1b3aadb97 1073741824" returned: 0 in 0.727s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-24444d91-0fc4-4c58-a81e-50c1b3aadb97 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:54 devstack sudo[85646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-24444d91-0fc4-4c58-a81e-50c1b3aadb97 Apr 28 05:50:54 devstack sudo[85646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:55 devstack sudo[85639]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-96337d29-842a-4231-90a6-94b34495c58b" returned: 0 in 0.723s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-96337d29-842a-4231-90a6-94b34495c58b {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:55 devstack sudo[85649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-96337d29-842a-4231-90a6-94b34495c58b Apr 28 05:50:55 devstack sudo[85649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:55 devstack sudo[85646]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-24444d91-0fc4-4c58-a81e-50c1b3aadb97" returned: 0 in 0.501s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:55 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:50:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:55 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16262f9d-474e-47a0-8fca-d63943ba3539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24444d91-0fc4-4c58-a81e-50c1b3aadb97', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:55 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7aaa4eb-dd5b-4230-8038-5bee16557043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:55 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Volume volume-24444d91-0fc4-4c58-a81e-50c1b3aadb97 (24444d91-0fc4-4c58-a81e-50c1b3aadb97): created successfully Apr 28 05:50:55 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7aaa4eb-dd5b-4230-8038-5bee16557043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:55 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Flow 'volume_create_manager' (8fb07161-beba-4905-becf-622d0c6970f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:50:55 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-b16a87ec-1bb5-4e96-9bcd-b3c5102587f1 tempest-VolumesListAdminTestJSON-994234865 None] Created volume successfully. Apr 28 05:50:55 devstack sudo[85649]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-96337d29-842a-4231-90a6-94b34495c58b" returned: 0 in 0.505s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:55 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Lock "cinder-quobyte-96337d29-842a-4231-90a6-94b34495c58b" released by "delete_volume" :: held 1.268s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:50:55 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Created reservations ['61b7b3eb-85e3-4ef6-b5c5-d5d25b8616ae'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:50:55 devstack cinder-volume[81829]: WARNING cinder.quota [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1784686007 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1784686007, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:50:55 devstack cinder-volume[81829]: WARNING cinder.quota [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1784686007 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1784686007, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:50:55 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Created reservations ['131aecdf-97ed-494e-b529-38fec9d95956', 'c7dffd63-d244-437a-9b00-24f4787799f8', '9560d48d-b826-49bd-b71b-0a0d465d8b43', '2b5f5c1c-391e-48ee-acfe-d4b805ed012e'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:50:55 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Created reservations ['216a4f7b-6dd5-48d8-8535-561c3ea1e764', 'abb46751-e45f-4ec1-baa7-199b49731589', 'f2fc6e06-f209-47ec-85a9-471fca1d5204', '21879865-3c13-4af7-92d6-f61e166613f5'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:50:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:55 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:50:55 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:50:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:56 devstack sudo[85659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:50:56 devstack sudo[85659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:56 devstack sudo[85659]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.543s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:50:56 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-7caf4a53-1e5b-4a8c-b4d1-f333a6f1aba9 tempest-GroupsTest-2114451673 None] Delete group completed successfully. Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Flow 'volume_create_manager' (382134ce-0d2a-4a93-a662-d1f30a059ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ad2f7a-f541-4e59-94c3-abe7cdc437bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ad2f7a-f541-4e59-94c3-abe7cdc437bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-932736093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5db324b-fde2-4885-91ea-7e7d5437ca5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb908defdb9944d3ac9b9750a39732f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:50:57Z,use_quota=True,user_id='e95e84c15bc0432c8cf2137dda57f5cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9d778c-e451-4ba4-a1e1-2a6ea4edb439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9d778c-e451-4ba4-a1e1-2a6ea4edb439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41511b56-f233-4afe-b3fc-dd4cb080d4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41511b56-f233-4afe-b3fc-dd4cb080d4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5db324b-fde2-4885-91ea-7e7d5437ca5d', 'volume_name': 'volume-c5db324b-fde2-4885-91ea-7e7d5437ca5d', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91925f06-1df9-4617-9a9e-963a9029d69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91925f06-1df9-4617-9a9e-963a9029d69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8844d3cb-8fa1-4586-a4fa-f41a91527654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:56 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Volume c5db324b-fde2-4885-91ea-7e7d5437ca5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5db324b-fde2-4885-91ea-7e7d5437ca5d', 'volume_size': 1} Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-932736093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5db324b-fde2-4885-91ea-7e7d5437ca5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb908defdb9944d3ac9b9750a39732f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:50:57Z,use_quota=True,user_id='e95e84c15bc0432c8cf2137dda57f5cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Creating volume c5db324b-fde2-4885-91ea-7e7d5437ca5d {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:50:56 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:50:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c5db324b-fde2-4885-91ea-7e7d5437ca5d 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:56 devstack sudo[85683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c5db324b-fde2-4885-91ea-7e7d5437ca5d 1073741824 Apr 28 05:50:56 devstack sudo[85683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:58 devstack sudo[85683]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c5db324b-fde2-4885-91ea-7e7d5437ca5d 1073741824" returned: 0 in 1.439s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c5db324b-fde2-4885-91ea-7e7d5437ca5d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:50:58 devstack sudo[85708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c5db324b-fde2-4885-91ea-7e7d5437ca5d Apr 28 05:50:58 devstack sudo[85708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:50:59 devstack sudo[85708]: pam_unix(sudo:session): session closed for user root Apr 28 05:50:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c5db324b-fde2-4885-91ea-7e7d5437ca5d" returned: 0 in 1.227s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:50:59 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] <== create_volume: return (2764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:50:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.767s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:50:59 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8844d3cb-8fa1-4586-a4fa-f41a91527654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5db324b-fde2-4885-91ea-7e7d5437ca5d', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:59 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de5ad117-3d4e-48aa-b637-f7655e19c83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:50:59 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Volume volume-c5db324b-fde2-4885-91ea-7e7d5437ca5d (c5db324b-fde2-4885-91ea-7e7d5437ca5d): created successfully Apr 28 05:50:59 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de5ad117-3d4e-48aa-b637-f7655e19c83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:50:59 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Flow 'volume_create_manager' (382134ce-0d2a-4a93-a662-d1f30a059ca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:50:59 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-3a567703-3684-413c-a5bc-bb979ecf0448 tempest-VolumesListAdminTestJSON-994234865 None] Created volume successfully. Apr 28 05:51:01 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:51:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Flow 'volume_create_manager' (012e8c80-fbe0-435b-9f19-59b5195e69ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:51:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c82da8e-7588-4a9e-aa67-6446d72304ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c82da8e-7588-4a9e-aa67-6446d72304ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48ed929-c0db-4678-8b3a-c68afda842ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3144db1ccec4f938090304f6d46530e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:51:02Z,use_quota=True,user_id='8e4dc1c6d91e4be48b8daccd1e4a7e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (449587ad-01c1-449e-8d03-fb9ef050b469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (449587ad-01c1-449e-8d03-fb9ef050b469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f5bca7-5903-4195-b48c-0881cfa7c138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f5bca7-5903-4195-b48c-0881cfa7c138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a48ed929-c0db-4678-8b3a-c68afda842ca', 'volume_name': 'volume-a48ed929-c0db-4678-8b3a-c68afda842ca', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4007ef-b6a8-4c72-a50c-54c6b9951138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4007ef-b6a8-4c72-a50c-54c6b9951138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414306fa-a46b-4d0b-adeb-07d810592b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:01 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Volume a48ed929-c0db-4678-8b3a-c68afda842ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a48ed929-c0db-4678-8b3a-c68afda842ca', 'volume_size': 1} Apr 28 05:51:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48ed929-c0db-4678-8b3a-c68afda842ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3144db1ccec4f938090304f6d46530e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:51:02Z,use_quota=True,user_id='8e4dc1c6d91e4be48b8daccd1e4a7e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:51:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Creating volume a48ed929-c0db-4678-8b3a-c68afda842ca {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:51:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:51:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:51:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:51:01 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:51:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a48ed929-c0db-4678-8b3a-c68afda842ca 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:01 devstack sudo[85721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a48ed929-c0db-4678-8b3a-c68afda842ca 1073741824 Apr 28 05:51:01 devstack sudo[85721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:02 devstack sudo[85721]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a48ed929-c0db-4678-8b3a-c68afda842ca 1073741824" returned: 0 in 1.060s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:02 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:SELECT=170,cinder:UPDATE=168,cinder:INSERT=41,cinder:DELETE=9 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:51:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a48ed929-c0db-4678-8b3a-c68afda842ca {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:02 devstack sudo[85732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a48ed929-c0db-4678-8b3a-c68afda842ca Apr 28 05:51:02 devstack sudo[85732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:03 devstack sudo[85732]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a48ed929-c0db-4678-8b3a-c68afda842ca" returned: 0 in 0.613s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:03 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:51:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414306fa-a46b-4d0b-adeb-07d810592b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a48ed929-c0db-4678-8b3a-c68afda842ca', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c3cfb5-b865-4ac9-9814-4044e0220f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:03 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Volume volume-a48ed929-c0db-4678-8b3a-c68afda842ca (a48ed929-c0db-4678-8b3a-c68afda842ca): created successfully Apr 28 05:51:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25c3cfb5-b865-4ac9-9814-4044e0220f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Flow 'volume_create_manager' (012e8c80-fbe0-435b-9f19-59b5195e69ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:51:03 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-9344a4ec-42e7-4605-af5f-992ff13255db tempest-VolumesListAdminTestJSON-1714364321 None] Created volume successfully. Apr 28 05:51:03 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-bde660e6-82ae-497e-b1be-7a67e7fbb2cb tempest-VolumesListAdminTestJSON-1714364321 None] Acquiring lock "cinder-a48ed929-c0db-4678-8b3a-c68afda842ca-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:51:03 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-bde660e6-82ae-497e-b1be-7a67e7fbb2cb tempest-VolumesListAdminTestJSON-1714364321 None] Lock "cinder-a48ed929-c0db-4678-8b3a-c68afda842ca-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:51:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7759988f-0d0c-4c56-96b6-ecb40cc0e5f3 tempest-VolumesListAdminTestJSON-994234865 None] Acquiring lock "cinder-c5db324b-fde2-4885-91ea-7e7d5437ca5d-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:51:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7759988f-0d0c-4c56-96b6-ecb40cc0e5f3 tempest-VolumesListAdminTestJSON-994234865 None] Lock "cinder-c5db324b-fde2-4885-91ea-7e7d5437ca5d-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:51:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-bde660e6-82ae-497e-b1be-7a67e7fbb2cb tempest-VolumesListAdminTestJSON-1714364321 None] Acquiring lock "cinder-quobyte-a48ed929-c0db-4678-8b3a-c68afda842ca" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:51:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-bde660e6-82ae-497e-b1be-7a67e7fbb2cb tempest-VolumesListAdminTestJSON-1714364321 None] Lock "cinder-quobyte-a48ed929-c0db-4678-8b3a-c68afda842ca" acquired by "delete_volume" :: waited 0.031s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:51:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7759988f-0d0c-4c56-96b6-ecb40cc0e5f3 tempest-VolumesListAdminTestJSON-994234865 None] Acquiring lock "cinder-quobyte-c5db324b-fde2-4885-91ea-7e7d5437ca5d" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:51:04 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ec86bd-238b-4c3d-bcdc-d2b718d03384]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:51:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-bde660e6-82ae-497e-b1be-7a67e7fbb2cb tempest-VolumesListAdminTestJSON-1714364321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a48ed929-c0db-4678-8b3a-c68afda842ca {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7759988f-0d0c-4c56-96b6-ecb40cc0e5f3 tempest-VolumesListAdminTestJSON-994234865 None] Lock "cinder-quobyte-c5db324b-fde2-4885-91ea-7e7d5437ca5d" acquired by "delete_volume" :: waited 0.059s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:51:04 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[922a24cb-254e-4fc1-bfc6-26523847e943]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:51:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7759988f-0d0c-4c56-96b6-ecb40cc0e5f3 tempest-VolumesListAdminTestJSON-994234865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c5db324b-fde2-4885-91ea-7e7d5437ca5d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:04 devstack sudo[85736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a48ed929-c0db-4678-8b3a-c68afda842ca Apr 28 05:51:04 devstack sudo[85736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:04 devstack sudo[85738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c5db324b-fde2-4885-91ea-7e7d5437ca5d Apr 28 05:51:04 devstack sudo[85738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:05 devstack sudo[85738]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7759988f-0d0c-4c56-96b6-ecb40cc0e5f3 tempest-VolumesListAdminTestJSON-994234865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c5db324b-fde2-4885-91ea-7e7d5437ca5d" returned: 0 in 1.058s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7759988f-0d0c-4c56-96b6-ecb40cc0e5f3 tempest-VolumesListAdminTestJSON-994234865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c5db324b-fde2-4885-91ea-7e7d5437ca5d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:05 devstack sudo[85746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c5db324b-fde2-4885-91ea-7e7d5437ca5d Apr 28 05:51:05 devstack sudo[85746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:51:05 devstack sudo[85736]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Flow 'volume_create_manager' (7aded1d9-a428-4d1f-b435-987ff7284369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded7ca5b-5b24-4bb5-b450-97d793184097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded7ca5b-5b24-4bb5-b450-97d793184097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-559445404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4c04bcb38c48158000872218d8de4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:51:06Z,use_quota=True,user_id='f4d6c37e057749409dc793bc7866222a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36a6c27f-5801-4243-938c-39260dc453b0),volume_type_id=36a6c27f-5801-4243-938c-39260dc453b0)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5c4d33-550c-413f-a220-bf3a74d80d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5c4d33-550c-413f-a220-bf3a74d80d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5f40cf-d1b9-4cb7-90cc-a44b8bfd8dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5f40cf-d1b9-4cb7-90cc-a44b8bfd8dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e', 'volume_name': 'volume-6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bdbb5ac-2b87-4da0-bcf5-cf45a78a9798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bdbb5ac-2b87-4da0-bcf5-cf45a78a9798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef2d461-bd07-4ba3-bacf-9ed72c36c8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:05 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Volume 6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e', 'volume_size': 1} Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-559445404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4c04bcb38c48158000872218d8de4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:51:06Z,use_quota=True,user_id='f4d6c37e057749409dc793bc7866222a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36a6c27f-5801-4243-938c-39260dc453b0),volume_type_id=36a6c27f-5801-4243-938c-39260dc453b0)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Creating volume 6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:51:05 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-bde660e6-82ae-497e-b1be-7a67e7fbb2cb tempest-VolumesListAdminTestJSON-1714364321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a48ed929-c0db-4678-8b3a-c68afda842ca" returned: 0 in 1.760s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-bde660e6-82ae-497e-b1be-7a67e7fbb2cb tempest-VolumesListAdminTestJSON-1714364321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a48ed929-c0db-4678-8b3a-c68afda842ca {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:05 devstack sudo[85750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a48ed929-c0db-4678-8b3a-c68afda842ca Apr 28 05:51:05 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:06 devstack sudo[85749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e 1073741824 Apr 28 05:51:06 devstack sudo[85749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:06 devstack sudo[85746]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7759988f-0d0c-4c56-96b6-ecb40cc0e5f3 tempest-VolumesListAdminTestJSON-994234865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c5db324b-fde2-4885-91ea-7e7d5437ca5d" returned: 0 in 0.887s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:06 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7759988f-0d0c-4c56-96b6-ecb40cc0e5f3 tempest-VolumesListAdminTestJSON-994234865 None] Lock "cinder-quobyte-c5db324b-fde2-4885-91ea-7e7d5437ca5d" released by "delete_volume" :: held 2.007s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:51:06 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-7759988f-0d0c-4c56-96b6-ecb40cc0e5f3 tempest-VolumesListAdminTestJSON-994234865 None] Created reservations ['02f289f9-9961-4c46-b984-9ba22e91c6df', '86364468-469e-4ca9-b8c2-e5f351be66cf', '892d8fed-4835-45b2-8216-4fd85126c2b6', 'b8fc4ea8-70b1-47b9-a97c-caae01e29e93'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:51:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7759988f-0d0c-4c56-96b6-ecb40cc0e5f3 tempest-VolumesListAdminTestJSON-994234865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7759988f-0d0c-4c56-96b6-ecb40cc0e5f3 tempest-VolumesListAdminTestJSON-994234865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7759988f-0d0c-4c56-96b6-ecb40cc0e5f3 tempest-VolumesListAdminTestJSON-994234865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:51:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7759988f-0d0c-4c56-96b6-ecb40cc0e5f3 tempest-VolumesListAdminTestJSON-994234865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:51:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7759988f-0d0c-4c56-96b6-ecb40cc0e5f3 tempest-VolumesListAdminTestJSON-994234865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7759988f-0d0c-4c56-96b6-ecb40cc0e5f3 tempest-VolumesListAdminTestJSON-994234865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:06 devstack sudo[85755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:51:06 devstack sudo[85755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:06 devstack cinder-volume[81829]: DEBUG oslo_service.periodic_task [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81829) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 05:51:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:51:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:51:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:07 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-bde660e6-82ae-497e-b1be-7a67e7fbb2cb tempest-VolumesListAdminTestJSON-1714364321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a48ed929-c0db-4678-8b3a-c68afda842ca" returned: 0 in 1.081s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:07 devstack sudo[85766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:51:07 devstack sudo[85766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:07 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-bde660e6-82ae-497e-b1be-7a67e7fbb2cb tempest-VolumesListAdminTestJSON-1714364321 None] Lock "cinder-quobyte-a48ed929-c0db-4678-8b3a-c68afda842ca" released by "delete_volume" :: held 2.923s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:51:07 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-bde660e6-82ae-497e-b1be-7a67e7fbb2cb tempest-VolumesListAdminTestJSON-1714364321 None] Created reservations ['3a2e4814-a42f-4970-b784-38cf9d16bace', '371f18e4-e554-482a-805d-4720e7c5832f', '2bfcfde3-74ec-4431-b343-e515ef3d394b', '2ebded6f-ddb8-4d9d-80e1-2eb29d035552'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:51:07 devstack sudo[85749]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e 1073741824" returned: 0 in 1.470s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-bde660e6-82ae-497e-b1be-7a67e7fbb2cb tempest-VolumesListAdminTestJSON-1714364321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-bde660e6-82ae-497e-b1be-7a67e7fbb2cb tempest-VolumesListAdminTestJSON-1714364321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:07 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-bde660e6-82ae-497e-b1be-7a67e7fbb2cb tempest-VolumesListAdminTestJSON-1714364321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:51:07 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-bde660e6-82ae-497e-b1be-7a67e7fbb2cb tempest-VolumesListAdminTestJSON-1714364321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:51:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-bde660e6-82ae-497e-b1be-7a67e7fbb2cb tempest-VolumesListAdminTestJSON-1714364321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-bde660e6-82ae-497e-b1be-7a67e7fbb2cb tempest-VolumesListAdminTestJSON-1714364321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:07 devstack sudo[85776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:51:07 devstack sudo[85776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:07 devstack sudo[85781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e Apr 28 05:51:07 devstack sudo[85781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:07 devstack sudo[85755]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7759988f-0d0c-4c56-96b6-ecb40cc0e5f3 tempest-VolumesListAdminTestJSON-994234865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 1.196s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:07 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-7759988f-0d0c-4c56-96b6-ecb40cc0e5f3 tempest-VolumesListAdminTestJSON-994234865 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:51:07 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-7759988f-0d0c-4c56-96b6-ecb40cc0e5f3 tempest-VolumesListAdminTestJSON-994234865 None] Deleted volume successfully. Apr 28 05:51:07 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cf1e20d9-e2e4-4950-8085-fee0d059872e tempest-VolumesListAdminTestJSON-994234865 None] Acquiring lock "cinder-24444d91-0fc4-4c58-a81e-50c1b3aadb97-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:51:07 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7759988f-0d0c-4c56-96b6-ecb40cc0e5f3 tempest-VolumesListAdminTestJSON-994234865 None] Lock "cinder-c5db324b-fde2-4885-91ea-7e7d5437ca5d-delete_volume" released by "delete_volume" :: held 3.656s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:51:07 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cf1e20d9-e2e4-4950-8085-fee0d059872e tempest-VolumesListAdminTestJSON-994234865 None] Lock "cinder-24444d91-0fc4-4c58-a81e-50c1b3aadb97-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:51:07 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cf1e20d9-e2e4-4950-8085-fee0d059872e tempest-VolumesListAdminTestJSON-994234865 None] Acquiring lock "cinder-quobyte-24444d91-0fc4-4c58-a81e-50c1b3aadb97" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:51:07 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cf1e20d9-e2e4-4950-8085-fee0d059872e tempest-VolumesListAdminTestJSON-994234865 None] Lock "cinder-quobyte-24444d91-0fc4-4c58-a81e-50c1b3aadb97" acquired by "delete_volume" :: waited 0.023s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:51:07 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f16a9f3-27d8-48ae-ab42-e3ba49d0a5bb]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:51:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cf1e20d9-e2e4-4950-8085-fee0d059872e tempest-VolumesListAdminTestJSON-994234865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-24444d91-0fc4-4c58-a81e-50c1b3aadb97 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:08 devstack sudo[85786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-24444d91-0fc4-4c58-a81e-50c1b3aadb97 Apr 28 05:51:08 devstack sudo[85786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:08 devstack sudo[85766]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 1.383s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:08 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:51:08 devstack sudo[85786]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cf1e20d9-e2e4-4950-8085-fee0d059872e tempest-VolumesListAdminTestJSON-994234865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-24444d91-0fc4-4c58-a81e-50c1b3aadb97" returned: 0 in 1.014s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cf1e20d9-e2e4-4950-8085-fee0d059872e tempest-VolumesListAdminTestJSON-994234865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-24444d91-0fc4-4c58-a81e-50c1b3aadb97 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:08 devstack sudo[85810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-24444d91-0fc4-4c58-a81e-50c1b3aadb97 Apr 28 05:51:08 devstack sudo[85810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:09 devstack sudo[85776]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-bde660e6-82ae-497e-b1be-7a67e7fbb2cb tempest-VolumesListAdminTestJSON-1714364321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 1.614s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:09 devstack sudo[85781]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:09 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-bde660e6-82ae-497e-b1be-7a67e7fbb2cb tempest-VolumesListAdminTestJSON-1714364321 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:51:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e" returned: 0 in 1.568s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] <== create_volume: return (3215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:51:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.220s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:09 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-bde660e6-82ae-497e-b1be-7a67e7fbb2cb tempest-VolumesListAdminTestJSON-1714364321 None] Deleted volume successfully. Apr 28 05:51:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef2d461-bd07-4ba3-bacf-9ed72c36c8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4a52290-7251-4811-bed6-18b27a67d684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:09 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Volume volume-6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e (6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e): created successfully Apr 28 05:51:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4a52290-7251-4811-bed6-18b27a67d684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Flow 'volume_create_manager' (7aded1d9-a428-4d1f-b435-987ff7284369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:51:09 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-4365fcd6-0912-4a55-8806-634b09d847e2 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Created volume successfully. Apr 28 05:51:09 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-bde660e6-82ae-497e-b1be-7a67e7fbb2cb tempest-VolumesListAdminTestJSON-1714364321 None] Lock "cinder-a48ed929-c0db-4678-8b3a-c68afda842ca-delete_volume" released by "delete_volume" :: held 5.314s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:51:09 devstack sudo[85810]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cf1e20d9-e2e4-4950-8085-fee0d059872e tempest-VolumesListAdminTestJSON-994234865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-24444d91-0fc4-4c58-a81e-50c1b3aadb97" returned: 0 in 0.790s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:09 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cf1e20d9-e2e4-4950-8085-fee0d059872e tempest-VolumesListAdminTestJSON-994234865 None] Lock "cinder-quobyte-24444d91-0fc4-4c58-a81e-50c1b3aadb97" released by "delete_volume" :: held 1.897s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:51:09 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-cf1e20d9-e2e4-4950-8085-fee0d059872e tempest-VolumesListAdminTestJSON-994234865 None] Created reservations ['85a518d3-c8f9-4128-aa5d-b5f1c65e45ab', '5bcd8fba-ea81-4092-87d1-b0a236cc45a5', 'e9be6eb0-5ed1-40ca-b736-894c702201f0', '03207831-0e66-49b2-a5b7-d9fae8217054'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:51:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cf1e20d9-e2e4-4950-8085-fee0d059872e tempest-VolumesListAdminTestJSON-994234865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cf1e20d9-e2e4-4950-8085-fee0d059872e tempest-VolumesListAdminTestJSON-994234865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:10 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cf1e20d9-e2e4-4950-8085-fee0d059872e tempest-VolumesListAdminTestJSON-994234865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:51:10 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cf1e20d9-e2e4-4950-8085-fee0d059872e tempest-VolumesListAdminTestJSON-994234865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:51:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cf1e20d9-e2e4-4950-8085-fee0d059872e tempest-VolumesListAdminTestJSON-994234865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cf1e20d9-e2e4-4950-8085-fee0d059872e tempest-VolumesListAdminTestJSON-994234865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:10 devstack sudo[85849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:51:10 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6a7d827a-7198-4fb1-8b63-f3ac517da527 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6a7d827a-7198-4fb1-8b63-f3ac517da527 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:10 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6a7d827a-7198-4fb1-8b63-f3ac517da527 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:51:10 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6a7d827a-7198-4fb1-8b63-f3ac517da527 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:51:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6a7d827a-7198-4fb1-8b63-f3ac517da527 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6a7d827a-7198-4fb1-8b63-f3ac517da527 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:10 devstack sudo[85851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:51:10 devstack sudo[85851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:10 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-56948d63-ea8e-44b8-9e78-11e9783ae704 tempest-VolumesListAdminTestJSON-994234865 None] Acquiring lock "cinder-2846edb8-8c33-41e9-8897-9369b033f735-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:51:10 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-56948d63-ea8e-44b8-9e78-11e9783ae704 tempest-VolumesListAdminTestJSON-994234865 None] Lock "cinder-2846edb8-8c33-41e9-8897-9369b033f735-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:51:10 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-56948d63-ea8e-44b8-9e78-11e9783ae704 tempest-VolumesListAdminTestJSON-994234865 None] Acquiring lock "cinder-quobyte-2846edb8-8c33-41e9-8897-9369b033f735" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:51:10 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-56948d63-ea8e-44b8-9e78-11e9783ae704 tempest-VolumesListAdminTestJSON-994234865 None] Lock "cinder-quobyte-2846edb8-8c33-41e9-8897-9369b033f735" acquired by "delete_volume" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:51:10 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[089753cb-fd08-41c4-8623-0b9851cb719b]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:51:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-56948d63-ea8e-44b8-9e78-11e9783ae704 tempest-VolumesListAdminTestJSON-994234865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2846edb8-8c33-41e9-8897-9369b033f735 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:10 devstack sudo[85854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2846edb8-8c33-41e9-8897-9369b033f735 Apr 28 05:51:10 devstack sudo[85854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:10 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cf1e20d9-e2e4-4950-8085-fee0d059872e tempest-VolumesListAdminTestJSON-994234865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.779s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:10 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-cf1e20d9-e2e4-4950-8085-fee0d059872e tempest-VolumesListAdminTestJSON-994234865 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:51:10 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-cf1e20d9-e2e4-4950-8085-fee0d059872e tempest-VolumesListAdminTestJSON-994234865 None] Deleted volume successfully. Apr 28 05:51:10 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cf1e20d9-e2e4-4950-8085-fee0d059872e tempest-VolumesListAdminTestJSON-994234865 None] Lock "cinder-24444d91-0fc4-4c58-a81e-50c1b3aadb97-delete_volume" released by "delete_volume" :: held 3.157s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:51:11 devstack sudo[85851]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6a7d827a-7198-4fb1-8b63-f3ac517da527 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 1.022s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:11 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-6a7d827a-7198-4fb1-8b63-f3ac517da527 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:51:11 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-6a7d827a-7198-4fb1-8b63-f3ac517da527 tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Retype volume completed successfully. Apr 28 05:51:11 devstack sudo[85854]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-56948d63-ea8e-44b8-9e78-11e9783ae704 tempest-VolumesListAdminTestJSON-994234865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2846edb8-8c33-41e9-8897-9369b033f735" returned: 0 in 0.850s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-56948d63-ea8e-44b8-9e78-11e9783ae704 tempest-VolumesListAdminTestJSON-994234865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2846edb8-8c33-41e9-8897-9369b033f735 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:11 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e6b46e02-5f2d-4653-b681-a117c43bd9ed tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Acquiring lock "cinder-6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:51:11 devstack sudo[85862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2846edb8-8c33-41e9-8897-9369b033f735 Apr 28 05:51:11 devstack sudo[85862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:11 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e6b46e02-5f2d-4653-b681-a117c43bd9ed tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Lock "cinder-6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:51:11 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e6b46e02-5f2d-4653-b681-a117c43bd9ed tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Acquiring lock "cinder-quobyte-6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:51:11 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e6b46e02-5f2d-4653-b681-a117c43bd9ed tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Lock "cinder-quobyte-6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e" acquired by "delete_volume" :: waited 0.020s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:51:11 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef524e42-1d6c-4861-af55-fb7ed45de2eb]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:51:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e6b46e02-5f2d-4653-b681-a117c43bd9ed tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:11 devstack sudo[85865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e Apr 28 05:51:11 devstack sudo[85865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:12 devstack sudo[85862]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-56948d63-ea8e-44b8-9e78-11e9783ae704 tempest-VolumesListAdminTestJSON-994234865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2846edb8-8c33-41e9-8897-9369b033f735" returned: 0 in 0.719s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:12 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-56948d63-ea8e-44b8-9e78-11e9783ae704 tempest-VolumesListAdminTestJSON-994234865 None] Lock "cinder-quobyte-2846edb8-8c33-41e9-8897-9369b033f735" released by "delete_volume" :: held 1.618s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:51:12 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-56948d63-ea8e-44b8-9e78-11e9783ae704 tempest-VolumesListAdminTestJSON-994234865 None] Created reservations ['702d878d-9042-40ab-8dcb-62bc392fb434', 'ec0c3ba2-c65c-4866-bb9b-2753ec7e515f', '083e557b-8db6-417e-9848-9967dadd90e1', '9a1ccfc5-6ef3-44f4-875d-e7d0d551c8a7'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:51:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-56948d63-ea8e-44b8-9e78-11e9783ae704 tempest-VolumesListAdminTestJSON-994234865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-56948d63-ea8e-44b8-9e78-11e9783ae704 tempest-VolumesListAdminTestJSON-994234865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:12 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-56948d63-ea8e-44b8-9e78-11e9783ae704 tempest-VolumesListAdminTestJSON-994234865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:51:12 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-56948d63-ea8e-44b8-9e78-11e9783ae704 tempest-VolumesListAdminTestJSON-994234865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:51:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-56948d63-ea8e-44b8-9e78-11e9783ae704 tempest-VolumesListAdminTestJSON-994234865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-56948d63-ea8e-44b8-9e78-11e9783ae704 tempest-VolumesListAdminTestJSON-994234865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:12 devstack sudo[85870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:51:12 devstack sudo[85870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:12 devstack sudo[85865]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e6b46e02-5f2d-4653-b681-a117c43bd9ed tempest-VolumeRetypeWithoutMigrationTest-219265896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e" returned: 0 in 0.866s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e6b46e02-5f2d-4653-b681-a117c43bd9ed tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:12 devstack sudo[85873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e Apr 28 05:51:12 devstack sudo[85873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:12 devstack sudo[85870]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-56948d63-ea8e-44b8-9e78-11e9783ae704 tempest-VolumesListAdminTestJSON-994234865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.632s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:12 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-56948d63-ea8e-44b8-9e78-11e9783ae704 tempest-VolumesListAdminTestJSON-994234865 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:51:12 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-56948d63-ea8e-44b8-9e78-11e9783ae704 tempest-VolumesListAdminTestJSON-994234865 None] Deleted volume successfully. Apr 28 05:51:12 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-56948d63-ea8e-44b8-9e78-11e9783ae704 tempest-VolumesListAdminTestJSON-994234865 None] Lock "cinder-2846edb8-8c33-41e9-8897-9369b033f735-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:51:13 devstack sudo[85873]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e6b46e02-5f2d-4653-b681-a117c43bd9ed tempest-VolumeRetypeWithoutMigrationTest-219265896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e" returned: 0 in 0.610s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:13 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e6b46e02-5f2d-4653-b681-a117c43bd9ed tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Lock "cinder-quobyte-6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e" released by "delete_volume" :: held 1.538s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:51:13 devstack cinder-volume[81829]: WARNING cinder.quota [None req-e6b46e02-5f2d-4653-b681-a117c43bd9ed tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:51:13 devstack cinder-volume[81829]: WARNING cinder.quota [None req-e6b46e02-5f2d-4653-b681-a117c43bd9ed tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:51:13 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-e6b46e02-5f2d-4653-b681-a117c43bd9ed tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Created reservations ['ed501a09-be17-4b16-a07c-fc7ac35b34e7', '4718636a-ce88-46f5-b1ef-9a6006960658', 'c1b2cb1b-884d-49e6-b739-e307e8699598', '7af8ce52-321f-46cc-96bf-73173e1ce410'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:51:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e6b46e02-5f2d-4653-b681-a117c43bd9ed tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e6b46e02-5f2d-4653-b681-a117c43bd9ed tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:13 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e6b46e02-5f2d-4653-b681-a117c43bd9ed tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:51:13 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e6b46e02-5f2d-4653-b681-a117c43bd9ed tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:51:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e6b46e02-5f2d-4653-b681-a117c43bd9ed tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e6b46e02-5f2d-4653-b681-a117c43bd9ed tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:13 devstack sudo[85878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:51:13 devstack sudo[85878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:14 devstack sudo[85878]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e6b46e02-5f2d-4653-b681-a117c43bd9ed tempest-VolumeRetypeWithoutMigrationTest-219265896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.717s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:14 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-e6b46e02-5f2d-4653-b681-a117c43bd9ed tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:51:14 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-e6b46e02-5f2d-4653-b681-a117c43bd9ed tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Deleted volume successfully. Apr 28 05:51:14 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e6b46e02-5f2d-4653-b681-a117c43bd9ed tempest-VolumeRetypeWithoutMigrationTest-219265896 None] Lock "cinder-6ff91212-0a9c-4c1d-83f5-6be6b1e7ed5e-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:SELECT=112,cinder:UPDATE=151,cinder:DELETE=7,cinder:INSERT=33 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Flow 'volume_create_manager' (560c5d3e-7ef7-4c2b-a7d3-7487ffc24617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2e7c56-8182-4d95-a245-8fc355e017ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2e7c56-8182-4d95-a245-8fc355e017ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1539050863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5789c569-013e-4e56-abb1-7e95c8fbabc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc7201268ff4634b5da859508a63782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:51:22Z,use_quota=True,user_id='a970a99fdfdb48869a34c756e347b834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dfce038-e1f7-4e4d-99c8-46c3400d7ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dfce038-e1f7-4e4d-99c8-46c3400d7ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0fceb1-8ee6-4d9e-8d8f-8d1d0bc9223e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0fceb1-8ee6-4d9e-8d8f-8d1d0bc9223e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5789c569-013e-4e56-abb1-7e95c8fbabc1', 'volume_name': 'volume-5789c569-013e-4e56-abb1-7e95c8fbabc1', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ff8dce-c738-4400-96be-7db4c34e7fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ff8dce-c738-4400-96be-7db4c34e7fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6ecf42-2a12-45f8-ad1c-332431e4b233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:21 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Volume 5789c569-013e-4e56-abb1-7e95c8fbabc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5789c569-013e-4e56-abb1-7e95c8fbabc1', 'volume_size': 1} Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1539050863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5789c569-013e-4e56-abb1-7e95c8fbabc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dc7201268ff4634b5da859508a63782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:51:22Z,use_quota=True,user_id='a970a99fdfdb48869a34c756e347b834',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Creating volume 5789c569-013e-4e56-abb1-7e95c8fbabc1 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:51:21 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:51:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:21 devstack sudo[85924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1 1073741824 Apr 28 05:51:21 devstack sudo[85924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:22 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:51:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Flow 'volume_create_manager' (4c03524a-5a8f-49a8-b999-83ca161f38b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:51:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673fc4a1-da6a-440e-b4ed-e231561cf2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673fc4a1-da6a-440e-b4ed-e231561cf2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:51:22Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ef5a8c-86cb-41d4-adab-d67334d93a84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e69f13ede9a434c93e4f4fbe6365369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:51:22Z,use_quota=True,user_id='b1bfcb1acebe4af1b50acf7947a89abe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f57b4e-dea0-4b7c-8e5b-50d92bb4d05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f57b4e-dea0-4b7c-8e5b-50d92bb4d05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9052f7b1-8f17-4e71-9465-faf3e5860214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:22 devstack cinder-volume[81829]: DEBUG cinder.image.glance [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Creating Keystone auth plugin from conf {{(pid=81829) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 28 05:51:22 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:51:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Flow 'volume_create_manager' (d3ceb314-e035-42cd-ba8d-1f9ec3fbaa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:51:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (691f64f8-dd93-4358-8d0f-ea0d9af45b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (691f64f8-dd93-4358-8d0f-ea0d9af45b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-894493620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d1fdf4-7d3a-4a88-b35c-177358673d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='886daeb4a7b9485e8e77483411130ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:51:22Z,use_quota=True,user_id='59e92d046e4645bf942cb1af7879b5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c3b4d4-5acd-4ca5-97f8-3920c9f86940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c3b4d4-5acd-4ca5-97f8-3920c9f86940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb88d0be-4748-48db-8f89-f67183777a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb88d0be-4748-48db-8f89-f67183777a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0d1fdf4-7d3a-4a88-b35c-177358673d56', 'volume_name': 'volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211086f8-1d0b-4140-ac04-cb574022a741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211086f8-1d0b-4140-ac04-cb574022a741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d390b397-389b-491f-9d71-92d15a80c9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:22 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Volume c0d1fdf4-7d3a-4a88-b35c-177358673d56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56', 'volume_size': 1} Apr 28 05:51:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:23 devstack sudo[85924]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1 1073741824" returned: 0 in 1.148s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9052f7b1-8f17-4e71-9465-faf3e5860214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '26ef5a8c-86cb-41d4-adab-d67334d93a84', 'volume_name': 'volume-26ef5a8c-86cb-41d4-adab-d67334d93a84', 'volume_size': 1, 'image_id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe365410c9347328bf4beafdac90830', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'created_at': datetime.datetime(2026, 4, 28, 3, 43, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 3, 43, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25b85b0b-bf76-421a-869b-c686c236a28b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3572eb-bc94-49fe-96a1-289281253d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3572eb-bc94-49fe-96a1-289281253d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d25547-12ff-4fa9-b3dc-c77ebc391579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:23 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Volume 26ef5a8c-86cb-41d4-adab-d67334d93a84: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-26ef5a8c-86cb-41d4-adab-d67334d93a84', 'volume_size': 1, 'image_id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe365410c9347328bf4beafdac90830', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'created_at': datetime.datetime(2026, 4, 28, 3, 43, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 3, 43, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25b85b0b-bf76-421a-869b-c686c236a28b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Trying to clone 26ef5a8c-86cb-41d4-adab-d67334d93a84 from image 25b85b0b-bf76-421a-869b-c686c236a28b at location (None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}]). {{(pid=81829) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:23 devstack sudo[85929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1 Apr 28 05:51:23 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_wsdmkd1idevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81829) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 28 05:51:23 devstack cinder-volume[81829]: INFO cinder.image.image_utils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Image download 20.69 MB at 20.69 MB/s Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e71fd4-75c9-467b-831e-d439455b6656]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_wsdmkd1idevstack@QuobyteHD {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:23 devstack sudo[85952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_wsdmkd1idevstack@QuobyteHD Apr 28 05:51:23 devstack sudo[85952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Flow 'volume_create_manager' (1d358f5e-633e-4bb9-9f87-cb2f58fc15ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4986077-da38-4cb7-a42a-906ddcdaf948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4986077-da38-4cb7-a42a-906ddcdaf948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-615687195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc88800-b19d-49b5-92d5-ddf59473c847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a926bc46814463c80895bb51293866a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:51:24Z,use_quota=True,user_id='409f3dea73d2422c811202e7dc5733d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6569dd20-9151-44a2-840a-60d8459c02c2),volume_type_id=6569dd20-9151-44a2-840a-60d8459c02c2)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c3e2af6-4aa0-4a64-a25b-9751bded7c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c3e2af6-4aa0-4a64-a25b-9751bded7c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92670df3-45f6-4a8e-a99c-9a037034dd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92670df3-45f6-4a8e-a99c-9a037034dd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bc88800-b19d-49b5-92d5-ddf59473c847', 'volume_name': 'volume-8bc88800-b19d-49b5-92d5-ddf59473c847', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba0216d-e667-4866-a967-26dbd087474c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba0216d-e667-4866-a967-26dbd087474c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546fa10c-3108-459d-982a-90bc4c8238e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:23 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Volume 8bc88800-b19d-49b5-92d5-ddf59473c847: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bc88800-b19d-49b5-92d5-ddf59473c847', 'volume_size': 1} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:23 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1" returned: 0 in 0.759s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] <== create_volume: return (2012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.016s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.390s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-894493620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d1fdf4-7d3a-4a88-b35c-177358673d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='886daeb4a7b9485e8e77483411130ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:51:22Z,use_quota=True,user_id='59e92d046e4645bf942cb1af7879b5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Creating volume c0d1fdf4-7d3a-4a88-b35c-177358673d56 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:51:23 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6ecf42-2a12-45f8-ad1c-332431e4b233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5789c569-013e-4e56-abb1-7e95c8fbabc1', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:23 devstack sudo[85955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56 1073741824 Apr 28 05:51:23 devstack sudo[85955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c9a741-dbbc-4e09-b97e-25417dff5d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:23 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Volume volume-5789c569-013e-4e56-abb1-7e95c8fbabc1 (5789c569-013e-4e56-abb1-7e95c8fbabc1): created successfully Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c9a741-dbbc-4e09-b97e-25417dff5d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:23 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Flow 'volume_create_manager' (560c5d3e-7ef7-4c2b-a7d3-7487ffc24617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:51:23 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-1c0daa26-a55b-4d05-af53-807ad029ae1e tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Created volume successfully. Apr 28 05:51:24 devstack sudo[85952]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_wsdmkd1idevstack@QuobyteHD" returned: 0 in 0.631s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:24 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Temporary image 25b85b0b-bf76-421a-869b-c686c236a28b is fetched for user b1bfcb1acebe4af1b50acf7947a89abe. {{(pid=81829) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 28 05:51:24 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3c488d-e750-4fa6-b68a-994836aa09a0]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:51:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_wsdmkd1idevstack@QuobyteHD {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:24 devstack sudo[85960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_wsdmkd1idevstack@QuobyteHD Apr 28 05:51:24 devstack sudo[85960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6e989812-02a2-49d5-8193-8febe3e22c28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:24 devstack sudo[85955]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56 1073741824" returned: 0 in 0.709s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:24 devstack sudo[85965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56 Apr 28 05:51:24 devstack sudo[85965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:24 devstack sudo[85960]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_wsdmkd1idevstack@QuobyteHD" returned: 0 in 0.606s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:25 devstack sudo[85965]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56" returned: 0 in 0.476s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:51:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.312s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-615687195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc88800-b19d-49b5-92d5-ddf59473c847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a926bc46814463c80895bb51293866a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:51:24Z,use_quota=True,user_id='409f3dea73d2422c811202e7dc5733d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6569dd20-9151-44a2-840a-60d8459c02c2),volume_type_id=6569dd20-9151-44a2-840a-60d8459c02c2)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:51:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Creating volume 8bc88800-b19d-49b5-92d5-ddf59473c847 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:51:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:51:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:51:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:51:25 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:51:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8bc88800-b19d-49b5-92d5-ddf59473c847 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d390b397-389b-491f-9d71-92d15a80c9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:25 devstack sudo[85971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8bc88800-b19d-49b5-92d5-ddf59473c847 1073741824 Apr 28 05:51:25 devstack sudo[85971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ce840d-08da-4636-b122-44f01dae3e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:25 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Volume volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56 (c0d1fdf4-7d3a-4a88-b35c-177358673d56): created successfully Apr 28 05:51:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ce840d-08da-4636-b122-44f01dae3e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Flow 'volume_create_manager' (d3ceb314-e035-42cd-ba8d-1f9ec3fbaa92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:51:25 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-f72b1b08-c91e-462e-a2e5-b9d37e25dcc8 tempest-SnapshotMetadataTestJSON-137841430 None] Created volume successfully. Apr 28 05:51:25 devstack sudo[85971]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8bc88800-b19d-49b5-92d5-ddf59473c847 1073741824" returned: 0 in 0.671s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8bc88800-b19d-49b5-92d5-ddf59473c847 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:25 devstack sudo[85976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8bc88800-b19d-49b5-92d5-ddf59473c847 Apr 28 05:51:25 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-edc6d2a7-db6e-456c-a5e4-55461156687e tempest-SnapshotMetadataTestJSON-137841430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:26 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8bc88800-b19d-49b5-92d5-ddf59473c847" returned: 0 in 0.459s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:51:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6e989812-02a2-49d5-8193-8febe3e22c28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.933s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546fa10c-3108-459d-982a-90bc4c8238e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bc88800-b19d-49b5-92d5-ddf59473c847', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e5a9e0-41dc-46c4-a326-7bfaff15a8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-6e989812-02a2-49d5-8193-8febe3e22c28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Creating offline snapshot 399ad122-6a8b-4ebd-8279-2672312f3023 of volume 5789c569-013e-4e56-abb1-7e95c8fbabc1 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:51:26 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Volume volume-8bc88800-b19d-49b5-92d5-ddf59473c847 (8bc88800-b19d-49b5-92d5-ddf59473c847): created successfully Apr 28 05:51:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e5a9e0-41dc-46c4-a326-7bfaff15a8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Flow 'volume_create_manager' (1d358f5e-633e-4bb9-9f87-cb2f58fc15ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:51:26 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8589b73-4032-47c9-ba1e-6287a1186ab3]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:51:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6e989812-02a2-49d5-8193-8febe3e22c28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:26 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-b4be24cb-1110-4d91-a6ec-b5b755cd434a tempest-VolumeTypesAccessTest-844381580 None] Created volume successfully. Apr 28 05:51:26 devstack sudo[85979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1 Apr 28 05:51:26 devstack sudo[85979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4e7a06c5-4565-4b8b-b67f-436fe1ae19e3 tempest-VolumeTypesAccessTest-844381580 None] Acquiring lock "cinder-8bc88800-b19d-49b5-92d5-ddf59473c847-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:51:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4e7a06c5-4565-4b8b-b67f-436fe1ae19e3 tempest-VolumeTypesAccessTest-844381580 None] Lock "cinder-8bc88800-b19d-49b5-92d5-ddf59473c847-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:51:26 devstack sudo[85979]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6e989812-02a2-49d5-8193-8febe3e22c28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1" returned: 0 in 0.563s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6e989812-02a2-49d5-8193-8febe3e22c28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.399ad122-6a8b-4ebd-8279-2672312f3023 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:26 devstack sudo[85984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.399ad122-6a8b-4ebd-8279-2672312f3023 1G Apr 28 05:51:26 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4e7a06c5-4565-4b8b-b67f-436fe1ae19e3 tempest-VolumeTypesAccessTest-844381580 None] Acquiring lock "cinder-quobyte-8bc88800-b19d-49b5-92d5-ddf59473c847" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:51:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4e7a06c5-4565-4b8b-b67f-436fe1ae19e3 tempest-VolumeTypesAccessTest-844381580 None] Lock "cinder-quobyte-8bc88800-b19d-49b5-92d5-ddf59473c847" acquired by "delete_volume" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:51:27 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be83b0f-3f2e-4ddc-a1c4-8e3225b986cb]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:51:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4e7a06c5-4565-4b8b-b67f-436fe1ae19e3 tempest-VolumeTypesAccessTest-844381580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8bc88800-b19d-49b5-92d5-ddf59473c847 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:27 devstack sudo[85986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8bc88800-b19d-49b5-92d5-ddf59473c847 Apr 28 05:51:27 devstack sudo[85986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:27 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6e989812-02a2-49d5-8193-8febe3e22c28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.399ad122-6a8b-4ebd-8279-2672312f3023 1G" returned: 0 in 0.655s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6e989812-02a2-49d5-8193-8febe3e22c28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5789c569-013e-4e56-abb1-7e95c8fbabc1 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.399ad122-6a8b-4ebd-8279-2672312f3023 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:27 devstack sudo[85986]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4e7a06c5-4565-4b8b-b67f-436fe1ae19e3 tempest-VolumeTypesAccessTest-844381580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8bc88800-b19d-49b5-92d5-ddf59473c847" returned: 0 in 0.578s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4e7a06c5-4565-4b8b-b67f-436fe1ae19e3 tempest-VolumeTypesAccessTest-844381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8bc88800-b19d-49b5-92d5-ddf59473c847 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:27 devstack sudo[85994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5789c569-013e-4e56-abb1-7e95c8fbabc1 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.399ad122-6a8b-4ebd-8279-2672312f3023 Apr 28 05:51:27 devstack sudo[85994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:27 devstack sudo[85996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8bc88800-b19d-49b5-92d5-ddf59473c847 Apr 28 05:51:27 devstack sudo[85996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:28 devstack sudo[85996]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4e7a06c5-4565-4b8b-b67f-436fe1ae19e3 tempest-VolumeTypesAccessTest-844381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8bc88800-b19d-49b5-92d5-ddf59473c847" returned: 0 in 0.441s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:28 devstack sudo[85994]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4e7a06c5-4565-4b8b-b67f-436fe1ae19e3 tempest-VolumeTypesAccessTest-844381580 None] Lock "cinder-quobyte-8bc88800-b19d-49b5-92d5-ddf59473c847" released by "delete_volume" :: held 1.062s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:51:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6e989812-02a2-49d5-8193-8febe3e22c28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5789c569-013e-4e56-abb1-7e95c8fbabc1 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.399ad122-6a8b-4ebd-8279-2672312f3023" returned: 0 in 0.489s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:28 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-6e989812-02a2-49d5-8193-8febe3e22c28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.399ad122-6a8b-4ebd-8279-2672312f3023 is being set with open permissions: ugo+rw Apr 28 05:51:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6e989812-02a2-49d5-8193-8febe3e22c28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.399ad122-6a8b-4ebd-8279-2672312f3023 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:28 devstack sudo[86002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.399ad122-6a8b-4ebd-8279-2672312f3023 Apr 28 05:51:28 devstack sudo[86002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:28 devstack cinder-volume[81829]: WARNING cinder.quota [None req-4e7a06c5-4565-4b8b-b67f-436fe1ae19e3 tempest-VolumeTypesAccessTest-844381580 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-62491461 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-62491461, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:51:28 devstack cinder-volume[81829]: WARNING cinder.quota [None req-4e7a06c5-4565-4b8b-b67f-436fe1ae19e3 tempest-VolumeTypesAccessTest-844381580 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-62491461 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-62491461, it is now deprecated. Please use the default quota class for default quota. Apr 28 05:51:28 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-4e7a06c5-4565-4b8b-b67f-436fe1ae19e3 tempest-VolumeTypesAccessTest-844381580 None] Created reservations ['752cef62-ea51-4104-928b-86eafec07b5f', 'bc0ce940-3e2e-4df3-9c8c-9bc8bcfb298d', '291eee83-b329-45b8-adde-ea69672c5efe', '9cb6aa2c-5320-4052-9aa0-d7ee200812b1'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:51:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4e7a06c5-4565-4b8b-b67f-436fe1ae19e3 tempest-VolumeTypesAccessTest-844381580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4e7a06c5-4565-4b8b-b67f-436fe1ae19e3 tempest-VolumeTypesAccessTest-844381580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4e7a06c5-4565-4b8b-b67f-436fe1ae19e3 tempest-VolumeTypesAccessTest-844381580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:51:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4e7a06c5-4565-4b8b-b67f-436fe1ae19e3 tempest-VolumeTypesAccessTest-844381580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:51:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4e7a06c5-4565-4b8b-b67f-436fe1ae19e3 tempest-VolumeTypesAccessTest-844381580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4e7a06c5-4565-4b8b-b67f-436fe1ae19e3 tempest-VolumeTypesAccessTest-844381580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:28 devstack sudo[86004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:51:28 devstack sudo[86004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:28 devstack sudo[86002]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6e989812-02a2-49d5-8193-8febe3e22c28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.399ad122-6a8b-4ebd-8279-2672312f3023" returned: 0 in 0.505s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6e989812-02a2-49d5-8193-8febe3e22c28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:28 devstack sudo[86008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.info Apr 28 05:51:28 devstack sudo[86008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:28 devstack sudo[86004]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4e7a06c5-4565-4b8b-b67f-436fe1ae19e3 tempest-VolumeTypesAccessTest-844381580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.473s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:28 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-4e7a06c5-4565-4b8b-b67f-436fe1ae19e3 tempest-VolumeTypesAccessTest-844381580 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:51:28 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-4e7a06c5-4565-4b8b-b67f-436fe1ae19e3 tempest-VolumeTypesAccessTest-844381580 None] Deleted volume successfully. Apr 28 05:51:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4e7a06c5-4565-4b8b-b67f-436fe1ae19e3 tempest-VolumeTypesAccessTest-844381580 None] Lock "cinder-8bc88800-b19d-49b5-92d5-ddf59473c847-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:51:29 devstack sudo[86008]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6e989812-02a2-49d5-8193-8febe3e22c28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.info" returned: 0 in 0.464s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:29 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-6e989812-02a2-49d5-8193-8febe3e22c28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.info is being set with open permissions: ugo+rw Apr 28 05:51:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6e989812-02a2-49d5-8193-8febe3e22c28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:29 devstack sudo[86011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.info Apr 28 05:51:29 devstack sudo[86011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:29 devstack sudo[86011]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6e989812-02a2-49d5-8193-8febe3e22c28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.info" returned: 0 in 0.529s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6e989812-02a2-49d5-8193-8febe3e22c28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.336s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.814s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:51:22Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ef5a8c-86cb-41d4-adab-d67334d93a84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e69f13ede9a434c93e4f4fbe6365369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:51:22Z,use_quota=True,user_id='b1bfcb1acebe4af1b50acf7947a89abe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:51:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Creating volume 26ef5a8c-86cb-41d4-adab-d67334d93a84 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:51:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:51:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:51:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:51:29 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:51:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:29 devstack sudo[86014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 1073741824 Apr 28 05:51:29 devstack sudo[86014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:29 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-6e989812-02a2-49d5-8193-8febe3e22c28 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Create snapshot completed successfully Apr 28 05:51:30 devstack sudo[86014]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 1073741824" returned: 0 in 0.714s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:30 devstack sudo[86019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 Apr 28 05:51:30 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:30 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84" returned: 0 in 0.538s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:51:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-edc6d2a7-db6e-456c-a5e4-55461156687e tempest-SnapshotMetadataTestJSON-137841430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.079s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-edc6d2a7-db6e-456c-a5e4-55461156687e tempest-SnapshotMetadataTestJSON-137841430 None] Creating offline snapshot 6b43396e-7db3-4fc2-a5ae-0c00652ae250 of volume c0d1fdf4-7d3a-4a88-b35c-177358673d56 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG cinder.volume.volume_utils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Attempting download of 25b85b0b-bf76-421a-869b-c686c236a28b ((None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}])) to volume 26ef5a8c-86cb-41d4-adab-d67334d93a84. {{(pid=81829) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[399a68bc-e7fb-4d31-a5c4-89ad06da39f0]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-edc6d2a7-db6e-456c-a5e4-55461156687e tempest-SnapshotMetadataTestJSON-137841430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75fc283-d50c-46ab-ab4c-57e0c9ff1ed4]: (4, 'raw') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_fnz2cfn3 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9ac30bd-a8de-48d3-8cce-9628307795c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Acquiring lock "cinder-399ad122-6a8b-4ebd-8279-2672312f3023-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9ac30bd-a8de-48d3-8cce-9628307795c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Lock "cinder-399ad122-6a8b-4ebd-8279-2672312f3023-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9ac30bd-a8de-48d3-8cce-9628307795c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Acquiring lock "cinder-quobyte-5789c569-013e-4e56-abb1-7e95c8fbabc1" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:51:31 devstack sudo[86023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56 Apr 28 05:51:31 devstack sudo[86023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:31 devstack sudo[86024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_fnz2cfn3 Apr 28 05:51:31 devstack sudo[86024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9ac30bd-a8de-48d3-8cce-9628307795c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Lock "cinder-quobyte-5789c569-013e-4e56-abb1-7e95c8fbabc1" acquired by "delete_snapshot" :: waited 0.057s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9ac30bd-a8de-48d3-8cce-9628307795c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Acquiring lock "cinder-quobyte-399ad122-6a8b-4ebd-8279-2672312f3023" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9ac30bd-a8de-48d3-8cce-9628307795c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Lock "cinder-quobyte-399ad122-6a8b-4ebd-8279-2672312f3023" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-b9ac30bd-a8de-48d3-8cce-9628307795c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Deleting offline snapshot 399ad122-6a8b-4ebd-8279-2672312f3023 of volume 5789c569-013e-4e56-abb1-7e95c8fbabc1 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-b9ac30bd-a8de-48d3-8cce-9628307795c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] snapshot_file for this snap is: volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.399ad122-6a8b-4ebd-8279-2672312f3023 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec794dab-4296-4738-b375-576bea740931]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9ac30bd-a8de-48d3-8cce-9628307795c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.399ad122-6a8b-4ebd-8279-2672312f3023 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:31 devstack sudo[86027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.399ad122-6a8b-4ebd-8279-2672312f3023 Apr 28 05:51:31 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:31 devstack sudo[86024]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_fnz2cfn3" returned: 0 in 0.756s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:31 devstack sudo[86023]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_fnz2cfn3 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-edc6d2a7-db6e-456c-a5e4-55461156687e tempest-SnapshotMetadataTestJSON-137841430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56" returned: 0 in 0.815s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-edc6d2a7-db6e-456c-a5e4-55461156687e tempest-SnapshotMetadataTestJSON-137841430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.6b43396e-7db3-4fc2-a5ae-0c00652ae250 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:31 devstack sudo[86038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.6b43396e-7db3-4fc2-a5ae-0c00652ae250 1G Apr 28 05:51:31 devstack sudo[86038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:31 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9ac30bd-a8de-48d3-8cce-9628307795c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.399ad122-6a8b-4ebd-8279-2672312f3023" returned: 0 in 0.584s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-b9ac30bd-a8de-48d3-8cce-9628307795c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5789c569-013e-4e56-abb1-7e95c8fbabc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:51:31 devstack sudo[86037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_fnz2cfn3 Apr 28 05:51:31 devstack sudo[86037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[607d5920-4e7d-41ad-9ea5-05181e3dc1dd]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:51:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9ac30bd-a8de-48d3-8cce-9628307795c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:32 devstack sudo[86041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1 Apr 28 05:51:32 devstack sudo[86041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:32 devstack sudo[86037]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_fnz2cfn3" returned: 1 in 0.648s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_fnz2cfn3' failed. Not Retrying. {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 05:51:32 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1786e8-e1c3-420b-888c-563ba6506315]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:51:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_wsdmkd1idevstack@QuobyteHD {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:32 devstack sudo[86050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_wsdmkd1idevstack@QuobyteHD Apr 28 05:51:32 devstack sudo[86050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:32 devstack sudo[86041]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9ac30bd-a8de-48d3-8cce-9628307795c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1" returned: 0 in 0.734s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9ac30bd-a8de-48d3-8cce-9628307795c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.399ad122-6a8b-4ebd-8279-2672312f3023 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:32 devstack sudo[86038]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:32 devstack sudo[86053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.399ad122-6a8b-4ebd-8279-2672312f3023 Apr 28 05:51:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-edc6d2a7-db6e-456c-a5e4-55461156687e tempest-SnapshotMetadataTestJSON-137841430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.6b43396e-7db3-4fc2-a5ae-0c00652ae250 1G" returned: 0 in 0.850s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-edc6d2a7-db6e-456c-a5e4-55461156687e tempest-SnapshotMetadataTestJSON-137841430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.6b43396e-7db3-4fc2-a5ae-0c00652ae250 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:32 devstack sudo[86053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:32 devstack sudo[86054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.6b43396e-7db3-4fc2-a5ae-0c00652ae250 Apr 28 05:51:32 devstack sudo[86054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:33 devstack sudo[86050]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_wsdmkd1idevstack@QuobyteHD" returned: 0 in 0.546s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:33 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] 25b85b0b-bf76-421a-869b-c686c236a28b was qcow2, converting to raw {{(pid=81829) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 28 05:51:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_wsdmkd1idevstack@QuobyteHD /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:33 devstack sudo[86060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_wsdmkd1idevstack@QuobyteHD /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 Apr 28 05:51:33 devstack sudo[86060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:33 devstack sudo[86054]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-edc6d2a7-db6e-456c-a5e4-55461156687e tempest-SnapshotMetadataTestJSON-137841430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.6b43396e-7db3-4fc2-a5ae-0c00652ae250" returned: 0 in 0.619s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:33 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-edc6d2a7-db6e-456c-a5e4-55461156687e tempest-SnapshotMetadataTestJSON-137841430 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.6b43396e-7db3-4fc2-a5ae-0c00652ae250 is being set with open permissions: ugo+rw Apr 28 05:51:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-edc6d2a7-db6e-456c-a5e4-55461156687e tempest-SnapshotMetadataTestJSON-137841430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.6b43396e-7db3-4fc2-a5ae-0c00652ae250 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:33 devstack sudo[86068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.6b43396e-7db3-4fc2-a5ae-0c00652ae250 Apr 28 05:51:33 devstack sudo[86068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:33 devstack sudo[86053]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9ac30bd-a8de-48d3-8cce-9628307795c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.399ad122-6a8b-4ebd-8279-2672312f3023" returned: 0 in 0.750s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9ac30bd-a8de-48d3-8cce-9628307795c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.399ad122-6a8b-4ebd-8279-2672312f3023 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:33 devstack sudo[86070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.399ad122-6a8b-4ebd-8279-2672312f3023 Apr 28 05:51:33 devstack sudo[86070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:34 devstack sudo[86068]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-edc6d2a7-db6e-456c-a5e4-55461156687e tempest-SnapshotMetadataTestJSON-137841430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.6b43396e-7db3-4fc2-a5ae-0c00652ae250" returned: 0 in 0.630s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-edc6d2a7-db6e-456c-a5e4-55461156687e tempest-SnapshotMetadataTestJSON-137841430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:34 devstack sudo[86070]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9ac30bd-a8de-48d3-8cce-9628307795c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1.399ad122-6a8b-4ebd-8279-2672312f3023" returned: 0 in 0.588s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:34 devstack sudo[86085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.info Apr 28 05:51:34 devstack sudo[86085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9ac30bd-a8de-48d3-8cce-9628307795c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Lock "cinder-quobyte-399ad122-6a8b-4ebd-8279-2672312f3023" released by "_delete_snapshot" :: held 2.787s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:51:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9ac30bd-a8de-48d3-8cce-9628307795c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Lock "cinder-quobyte-5789c569-013e-4e56-abb1-7e95c8fbabc1" released by "delete_snapshot" :: held 2.851s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:51:34 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-b9ac30bd-a8de-48d3-8cce-9628307795c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Created reservations ['4d302e83-1cd2-415b-b069-6de0850025b4', '3a558d30-d760-48a5-be01-ad166389699f', 'a6783f27-0a58-4cbb-8a4a-ef054e0c2dd7', '4127cf44-63f7-439a-935d-8ac832262a1d'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:51:34 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-b9ac30bd-a8de-48d3-8cce-9628307795c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Delete snapshot completed successfully. Apr 28 05:51:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9ac30bd-a8de-48d3-8cce-9628307795c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Lock "cinder-399ad122-6a8b-4ebd-8279-2672312f3023-delete_snapshot" released by "delete_snapshot" :: held 3.058s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:51:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-65be7be0-838b-48e9-930e-866b02c351f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Acquiring lock "cinder-5789c569-013e-4e56-abb1-7e95c8fbabc1-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:51:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-65be7be0-838b-48e9-930e-866b02c351f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Lock "cinder-5789c569-013e-4e56-abb1-7e95c8fbabc1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:51:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-65be7be0-838b-48e9-930e-866b02c351f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Acquiring lock "cinder-quobyte-5789c569-013e-4e56-abb1-7e95c8fbabc1" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:51:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-65be7be0-838b-48e9-930e-866b02c351f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Lock "cinder-quobyte-5789c569-013e-4e56-abb1-7e95c8fbabc1" acquired by "delete_volume" :: waited 0.014s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:51:34 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[127b86f1-d092-495b-9394-c55877418f1d]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:51:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-65be7be0-838b-48e9-930e-866b02c351f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:34 devstack sudo[86085]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-edc6d2a7-db6e-456c-a5e4-55461156687e tempest-SnapshotMetadataTestJSON-137841430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.info" returned: 0 in 0.683s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:34 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-edc6d2a7-db6e-456c-a5e4-55461156687e tempest-SnapshotMetadataTestJSON-137841430 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.info is being set with open permissions: ugo+rw Apr 28 05:51:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-edc6d2a7-db6e-456c-a5e4-55461156687e tempest-SnapshotMetadataTestJSON-137841430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:34 devstack sudo[86089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.info Apr 28 05:51:34 devstack sudo[86089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:34 devstack sudo[86060]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_wsdmkd1idevstack@QuobyteHD /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84" returned: 0 in 1.685s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:34 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_wsdmkd1idevstack@QuobyteHD, size 112.00 MB, duration 1.69 sec, destination /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 {{(pid=81829) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:51:34 devstack cinder-volume[81829]: INFO cinder.image.image_utils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Converted 112.00 MB image at 66.43 MB/s Apr 28 05:51:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:34 devstack sudo[86088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1 Apr 28 05:51:34 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:34 devstack sudo[86091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 1G Apr 28 05:51:34 devstack sudo[86091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:35 devstack sudo[86089]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-edc6d2a7-db6e-456c-a5e4-55461156687e tempest-SnapshotMetadataTestJSON-137841430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.info" returned: 0 in 0.609s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-edc6d2a7-db6e-456c-a5e4-55461156687e tempest-SnapshotMetadataTestJSON-137841430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.383s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:35 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-edc6d2a7-db6e-456c-a5e4-55461156687e tempest-SnapshotMetadataTestJSON-137841430 None] Create snapshot completed successfully Apr 28 05:51:35 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-65be7be0-838b-48e9-930e-866b02c351f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1" returned: 0 in 0.728s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-65be7be0-838b-48e9-930e-866b02c351f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:35 devstack sudo[86091]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:35 devstack sudo[86101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1 Apr 28 05:51:35 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 1G" returned: 0 in 0.700s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:35 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d1ab15-73c7-456f-8c66-d62a7e882aa0]: (4, 'raw') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:51:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:35 devstack sudo[86103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 Apr 28 05:51:35 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:35 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-65be7be0-838b-48e9-930e-866b02c351f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5789c569-013e-4e56-abb1-7e95c8fbabc1" returned: 0 in 0.504s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:35 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-65be7be0-838b-48e9-930e-866b02c351f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Lock "cinder-quobyte-5789c569-013e-4e56-abb1-7e95c8fbabc1" released by "delete_volume" :: held 1.291s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:51:36 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-65be7be0-838b-48e9-930e-866b02c351f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Created reservations ['53cfe8d3-59c4-4baf-a179-295e4bd02b2e', 'b15e62bf-ffca-485a-94bc-c7fbcc7b1220', '1686de49-b640-415c-ad37-8f458b373021', '0886f6b2-94e2-49ec-a57b-ed2a2df62def'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:51:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-65be7be0-838b-48e9-930e-866b02c351f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-65be7be0-838b-48e9-930e-866b02c351f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:36 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-65be7be0-838b-48e9-930e-866b02c351f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:51:36 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-65be7be0-838b-48e9-930e-866b02c351f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:51:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-65be7be0-838b-48e9-930e-866b02c351f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-65be7be0-838b-48e9-930e-866b02c351f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:36 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84" returned: 0 in 0.612s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:36 devstack sudo[86108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:51:36 devstack sudo[86108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:36 devstack sudo[86109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 Apr 28 05:51:36 devstack sudo[86109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:36 devstack sudo[86108]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-65be7be0-838b-48e9-930e-866b02c351f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.651s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:36 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-65be7be0-838b-48e9-930e-866b02c351f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:51:36 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-65be7be0-838b-48e9-930e-866b02c351f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Deleted volume successfully. Apr 28 05:51:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-65be7be0-838b-48e9-930e-866b02c351f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1534854725 None] Lock "cinder-5789c569-013e-4e56-abb1-7e95c8fbabc1-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:51:36 devstack sudo[86109]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84" returned: 1 in 0.737s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84' failed. Not Retrying. {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 05:51:36 devstack cinder-volume[81829]: DEBUG cinder.volume.volume_utils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Downloaded image 25b85b0b-bf76-421a-869b-c686c236a28b ((None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}])) to volume 26ef5a8c-86cb-41d4-adab-d67334d93a84 successfully. {{(pid=81829) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 28 05:51:36 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Temporary image 25b85b0b-bf76-421a-869b-c686c236a28b for user b1bfcb1acebe4af1b50acf7947a89abe is deleted. {{(pid=81829) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 28 05:51:36 devstack cinder-volume[81829]: DEBUG cinder.volume.volume_utils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Marking volume 26ef5a8c-86cb-41d4-adab-d67334d93a84 as bootable. {{(pid=81829) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 28 05:51:36 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Copying metadata from image 25b85b0b-bf76-421a-869b-c686c236a28b to 26ef5a8c-86cb-41d4-adab-d67334d93a84. {{(pid=81829) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 28 05:51:36 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Creating volume glance metadata for volume 26ef5a8c-86cb-41d4-adab-d67334d93a84 backed by image 25b85b0b-bf76-421a-869b-c686c236a28b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81829) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 28 05:51:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d25547-12ff-4fa9-b3dc-c77ebc391579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26ef5a8c-86cb-41d4-adab-d67334d93a84', 'volume_size': 1, 'image_id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe365410c9347328bf4beafdac90830', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'created_at': datetime.datetime(2026, 4, 28, 3, 43, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 3, 43, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25b85b0b-bf76-421a-869b-c686c236a28b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d8b36f3-a61b-4bb2-87a1-9d58749221a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:37 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Volume volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 (26ef5a8c-86cb-41d4-adab-d67334d93a84): created successfully Apr 28 05:51:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d8b36f3-a61b-4bb2-87a1-9d58749221a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Flow 'volume_create_manager' (4c03524a-5a8f-49a8-b999-83ca161f38b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:51:37 devstack cinder-volume[81829]: INFO cinder.volume.manager [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-66d26eec-8c53-49f6-aed4-cfda7812d66a tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Created volume successfully. Apr 28 05:51:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-990c750f-dba7-4aee-8435-ebffa1223634 tempest-SnapshotMetadataTestJSON-137841430 None] Acquiring lock "cinder-6b43396e-7db3-4fc2-a5ae-0c00652ae250-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:51:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-990c750f-dba7-4aee-8435-ebffa1223634 tempest-SnapshotMetadataTestJSON-137841430 None] Lock "cinder-6b43396e-7db3-4fc2-a5ae-0c00652ae250-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:51:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-990c750f-dba7-4aee-8435-ebffa1223634 tempest-SnapshotMetadataTestJSON-137841430 None] Acquiring lock "cinder-quobyte-c0d1fdf4-7d3a-4a88-b35c-177358673d56" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:51:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-990c750f-dba7-4aee-8435-ebffa1223634 tempest-SnapshotMetadataTestJSON-137841430 None] Lock "cinder-quobyte-c0d1fdf4-7d3a-4a88-b35c-177358673d56" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:51:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-990c750f-dba7-4aee-8435-ebffa1223634 tempest-SnapshotMetadataTestJSON-137841430 None] Acquiring lock "cinder-quobyte-6b43396e-7db3-4fc2-a5ae-0c00652ae250" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:51:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-990c750f-dba7-4aee-8435-ebffa1223634 tempest-SnapshotMetadataTestJSON-137841430 None] Lock "cinder-quobyte-6b43396e-7db3-4fc2-a5ae-0c00652ae250" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:51:37 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-990c750f-dba7-4aee-8435-ebffa1223634 tempest-SnapshotMetadataTestJSON-137841430 None] Deleting offline snapshot 6b43396e-7db3-4fc2-a5ae-0c00652ae250 of volume c0d1fdf4-7d3a-4a88-b35c-177358673d56 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:51:37 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-990c750f-dba7-4aee-8435-ebffa1223634 tempest-SnapshotMetadataTestJSON-137841430 None] snapshot_file for this snap is: volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.6b43396e-7db3-4fc2-a5ae-0c00652ae250 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:51:37 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5073dc-b84c-437a-8b52-70de7b969282]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:51:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-990c750f-dba7-4aee-8435-ebffa1223634 tempest-SnapshotMetadataTestJSON-137841430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.6b43396e-7db3-4fc2-a5ae-0c00652ae250 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:37 devstack sudo[86116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.6b43396e-7db3-4fc2-a5ae-0c00652ae250 Apr 28 05:51:37 devstack sudo[86116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-02716a9e-b2d8-4159-a7c0-9ed05ef51aef tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-02716a9e-b2d8-4159-a7c0-9ed05ef51aef tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:38 devstack sudo[86116]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-990c750f-dba7-4aee-8435-ebffa1223634 tempest-SnapshotMetadataTestJSON-137841430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.6b43396e-7db3-4fc2-a5ae-0c00652ae250" returned: 0 in 0.747s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:38 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-990c750f-dba7-4aee-8435-ebffa1223634 tempest-SnapshotMetadataTestJSON-137841430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:51:38 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[5905430f-2f50-425b-9cb2-34608bcadc0b]: (4, 'raw') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:51:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-02716a9e-b2d8-4159-a7c0-9ed05ef51aef tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:38 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fd295c-c521-4013-816d-13269020108c]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:51:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-990c750f-dba7-4aee-8435-ebffa1223634 tempest-SnapshotMetadataTestJSON-137841430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:38 devstack sudo[86129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 Apr 28 05:51:38 devstack sudo[86129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:38 devstack sudo[86130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56 Apr 28 05:51:38 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:38 devstack sudo[86129]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-02716a9e-b2d8-4159-a7c0-9ed05ef51aef tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84" returned: 0 in 0.716s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-02716a9e-b2d8-4159-a7c0-9ed05ef51aef tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:38 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-990c750f-dba7-4aee-8435-ebffa1223634 tempest-SnapshotMetadataTestJSON-137841430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56" returned: 0 in 0.762s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-990c750f-dba7-4aee-8435-ebffa1223634 tempest-SnapshotMetadataTestJSON-137841430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.6b43396e-7db3-4fc2-a5ae-0c00652ae250 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:38 devstack sudo[86139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.6b43396e-7db3-4fc2-a5ae-0c00652ae250 Apr 28 05:51:38 devstack sudo[86139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:38 devstack sudo[86138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 Apr 28 05:51:38 devstack sudo[86138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:39 devstack sudo[86138]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-02716a9e-b2d8-4159-a7c0-9ed05ef51aef tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84" returned: 1 in 0.723s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-02716a9e-b2d8-4159-a7c0-9ed05ef51aef tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84' failed. Not Retrying. {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 05:51:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-02716a9e-b2d8-4159-a7c0-9ed05ef51aef tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.487s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-02716a9e-b2d8-4159-a7c0-9ed05ef51aef tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381', 'name': 'volume-26ef5a8c-86cb-41d4-adab-d67334d93a84', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee290ed5-ac28-49a3-a7a9-33220262c7e5', 'enforce_multipath': True} {{(pid=81829) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 28 05:51:39 devstack sudo[86139]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-990c750f-dba7-4aee-8435-ebffa1223634 tempest-SnapshotMetadataTestJSON-137841430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.6b43396e-7db3-4fc2-a5ae-0c00652ae250" returned: 0 in 0.738s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-990c750f-dba7-4aee-8435-ebffa1223634 tempest-SnapshotMetadataTestJSON-137841430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.6b43396e-7db3-4fc2-a5ae-0c00652ae250 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:39 devstack sudo[86148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.6b43396e-7db3-4fc2-a5ae-0c00652ae250 Apr 28 05:51:39 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:39 devstack cinder-volume[81829]: INFO cinder.volume.manager [req-2d15e5ad-869b-4000-a069-d3cf276b751a req-02716a9e-b2d8-4159-a7c0-9ed05ef51aef tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] attachment_update completed successfully. Apr 28 05:51:40 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-990c750f-dba7-4aee-8435-ebffa1223634 tempest-SnapshotMetadataTestJSON-137841430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56.6b43396e-7db3-4fc2-a5ae-0c00652ae250" returned: 0 in 0.708s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-990c750f-dba7-4aee-8435-ebffa1223634 tempest-SnapshotMetadataTestJSON-137841430 None] Lock "cinder-quobyte-6b43396e-7db3-4fc2-a5ae-0c00652ae250" released by "_delete_snapshot" :: held 3.092s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:51:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-990c750f-dba7-4aee-8435-ebffa1223634 tempest-SnapshotMetadataTestJSON-137841430 None] Lock "cinder-quobyte-c0d1fdf4-7d3a-4a88-b35c-177358673d56" released by "delete_snapshot" :: held 3.121s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:51:40 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-990c750f-dba7-4aee-8435-ebffa1223634 tempest-SnapshotMetadataTestJSON-137841430 None] Created reservations ['3ea1ddfb-6742-4b09-9a5c-f57f27e5d221', '1d3960a2-680c-4b85-9011-4c085ac252e5', '39444074-5c37-42ae-8664-6a5f3f8ed6e5', '7152c45d-776d-485b-b8eb-596b43a2d175'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:51:40 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-990c750f-dba7-4aee-8435-ebffa1223634 tempest-SnapshotMetadataTestJSON-137841430 None] Delete snapshot completed successfully. Apr 28 05:51:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-990c750f-dba7-4aee-8435-ebffa1223634 tempest-SnapshotMetadataTestJSON-137841430 None] Lock "cinder-6b43396e-7db3-4fc2-a5ae-0c00652ae250-delete_snapshot" released by "delete_snapshot" :: held 3.295s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:51:41 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3db90b8d-bc93-406d-a030-917066ddb7c6 tempest-SnapshotMetadataTestJSON-137841430 None] Acquiring lock "cinder-c0d1fdf4-7d3a-4a88-b35c-177358673d56-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:51:41 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3db90b8d-bc93-406d-a030-917066ddb7c6 tempest-SnapshotMetadataTestJSON-137841430 None] Lock "cinder-c0d1fdf4-7d3a-4a88-b35c-177358673d56-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:51:41 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3db90b8d-bc93-406d-a030-917066ddb7c6 tempest-SnapshotMetadataTestJSON-137841430 None] Acquiring lock "cinder-quobyte-c0d1fdf4-7d3a-4a88-b35c-177358673d56" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:51:41 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3db90b8d-bc93-406d-a030-917066ddb7c6 tempest-SnapshotMetadataTestJSON-137841430 None] Lock "cinder-quobyte-c0d1fdf4-7d3a-4a88-b35c-177358673d56" acquired by "delete_volume" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:51:41 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03b84da-f09c-4522-beeb-d99ea9444145]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:51:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3db90b8d-bc93-406d-a030-917066ddb7c6 tempest-SnapshotMetadataTestJSON-137841430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:41 devstack sudo[86154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56 Apr 28 05:51:41 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:42 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3db90b8d-bc93-406d-a030-917066ddb7c6 tempest-SnapshotMetadataTestJSON-137841430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56" returned: 0 in 0.719s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3db90b8d-bc93-406d-a030-917066ddb7c6 tempest-SnapshotMetadataTestJSON-137841430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:42 devstack sudo[86159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56 Apr 28 05:51:42 devstack sudo[86159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:43 devstack sudo[86159]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3db90b8d-bc93-406d-a030-917066ddb7c6 tempest-SnapshotMetadataTestJSON-137841430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c0d1fdf4-7d3a-4a88-b35c-177358673d56" returned: 0 in 0.664s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:43 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3db90b8d-bc93-406d-a030-917066ddb7c6 tempest-SnapshotMetadataTestJSON-137841430 None] Lock "cinder-quobyte-c0d1fdf4-7d3a-4a88-b35c-177358673d56" released by "delete_volume" :: held 1.486s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:51:43 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-3db90b8d-bc93-406d-a030-917066ddb7c6 tempest-SnapshotMetadataTestJSON-137841430 None] Created reservations ['1faa4b4d-fc07-4f4e-8b65-76f05e814a67', '66d36a60-6744-4fda-8e6c-e1a887596958', 'a2ba9f82-fbf6-4b52-b031-7a511ce888b2', '4e5436e6-c5f8-4981-90f3-075ca9c615e4'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:51:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3db90b8d-bc93-406d-a030-917066ddb7c6 tempest-SnapshotMetadataTestJSON-137841430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3db90b8d-bc93-406d-a030-917066ddb7c6 tempest-SnapshotMetadataTestJSON-137841430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:43 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3db90b8d-bc93-406d-a030-917066ddb7c6 tempest-SnapshotMetadataTestJSON-137841430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:51:43 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3db90b8d-bc93-406d-a030-917066ddb7c6 tempest-SnapshotMetadataTestJSON-137841430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:51:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3db90b8d-bc93-406d-a030-917066ddb7c6 tempest-SnapshotMetadataTestJSON-137841430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3db90b8d-bc93-406d-a030-917066ddb7c6 tempest-SnapshotMetadataTestJSON-137841430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:43 devstack sudo[86165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:51:43 devstack sudo[86165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:43 devstack sudo[86165]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3db90b8d-bc93-406d-a030-917066ddb7c6 tempest-SnapshotMetadataTestJSON-137841430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.503s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:43 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-3db90b8d-bc93-406d-a030-917066ddb7c6 tempest-SnapshotMetadataTestJSON-137841430 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:51:43 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-3db90b8d-bc93-406d-a030-917066ddb7c6 tempest-SnapshotMetadataTestJSON-137841430 None] Deleted volume successfully. Apr 28 05:51:43 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3db90b8d-bc93-406d-a030-917066ddb7c6 tempest-SnapshotMetadataTestJSON-137841430 None] Lock "cinder-c0d1fdf4-7d3a-4a88-b35c-177358673d56-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:51:53 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:SELECT=49,cinder:UPDATE=44,cinder:INSERT=23,cinder:DELETE=4 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:51:53 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:UPDATE=101,cinder:DELETE=9,cinder:SELECT=91,cinder:INSERT=26 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:51:56 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:51:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Flow 'volume_create_manager' (715def5e-ede5-4ea7-99f2-14db755703c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:51:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf03ef0b-4529-4965-855a-8a4ce5c6f5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf03ef0b-4529-4965-855a-8a4ce5c6f5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-911668946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a294e465-a189-47dc-93e9-fd66d3796120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de01950b727e40ac92058680c90d6fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:51:57Z,use_quota=True,user_id='ebf10aeabc094b27b41f44d26801a660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74481c39-adf7-4ce8-9941-359f85e0e7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74481c39-adf7-4ce8-9941-359f85e0e7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8627caea-c69d-4ea0-97fc-a005474ddfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8627caea-c69d-4ea0-97fc-a005474ddfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a294e465-a189-47dc-93e9-fd66d3796120', 'volume_name': 'volume-a294e465-a189-47dc-93e9-fd66d3796120', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96db533e-3cc1-4ed9-b695-0e54ce747586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96db533e-3cc1-4ed9-b695-0e54ce747586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840c3cca-4884-4e35-a609-5543de8425cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:57 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Volume a294e465-a189-47dc-93e9-fd66d3796120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a294e465-a189-47dc-93e9-fd66d3796120', 'volume_size': 1} Apr 28 05:51:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-911668946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a294e465-a189-47dc-93e9-fd66d3796120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de01950b727e40ac92058680c90d6fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:51:57Z,use_quota=True,user_id='ebf10aeabc094b27b41f44d26801a660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:51:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Creating volume a294e465-a189-47dc-93e9-fd66d3796120 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:51:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:51:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:51:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:51:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:51:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:51:57 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:51:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a294e465-a189-47dc-93e9-fd66d3796120 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:57 devstack sudo[86236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a294e465-a189-47dc-93e9-fd66d3796120 1073741824 Apr 28 05:51:57 devstack sudo[86236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:58 devstack sudo[86236]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a294e465-a189-47dc-93e9-fd66d3796120 1073741824" returned: 0 in 1.302s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a294e465-a189-47dc-93e9-fd66d3796120 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:51:58 devstack sudo[86241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a294e465-a189-47dc-93e9-fd66d3796120 Apr 28 05:51:58 devstack sudo[86241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:51:59 devstack sudo[86241]: pam_unix(sudo:session): session closed for user root Apr 28 05:51:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a294e465-a189-47dc-93e9-fd66d3796120" returned: 0 in 0.871s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:51:59 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] <== create_volume: return (2323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:51:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.330s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:51:59 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840c3cca-4884-4e35-a609-5543de8425cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a294e465-a189-47dc-93e9-fd66d3796120', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:59 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c6bdb9-d269-4227-9b51-d82e8842fb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:51:59 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Volume volume-a294e465-a189-47dc-93e9-fd66d3796120 (a294e465-a189-47dc-93e9-fd66d3796120): created successfully Apr 28 05:51:59 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c6bdb9-d269-4227-9b51-d82e8842fb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:51:59 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Flow 'volume_create_manager' (715def5e-ede5-4ea7-99f2-14db755703c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:51:59 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-30493a6c-ab37-4297-9595-172798eca3bf tempest-AbsoluteLimitsTests-1360724911 None] Created volume successfully. Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-de29ce87-ad22-45d7-bf34-8addc00b1953 tempest-AbsoluteLimitsTests-1360724911 None] Acquiring lock "cinder-a294e465-a189-47dc-93e9-fd66d3796120-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-de29ce87-ad22-45d7-bf34-8addc00b1953 tempest-AbsoluteLimitsTests-1360724911 None] Lock "cinder-a294e465-a189-47dc-93e9-fd66d3796120-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-de29ce87-ad22-45d7-bf34-8addc00b1953 tempest-AbsoluteLimitsTests-1360724911 None] Acquiring lock "cinder-quobyte-a294e465-a189-47dc-93e9-fd66d3796120" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-de29ce87-ad22-45d7-bf34-8addc00b1953 tempest-AbsoluteLimitsTests-1360724911 None] Lock "cinder-quobyte-a294e465-a189-47dc-93e9-fd66d3796120" acquired by "delete_volume" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4353248-c153-425a-a74f-80c0e83a455d]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-de29ce87-ad22-45d7-bf34-8addc00b1953 tempest-AbsoluteLimitsTests-1360724911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a294e465-a189-47dc-93e9-fd66d3796120 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:52:00 devstack sudo[86271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a294e465-a189-47dc-93e9-fd66d3796120 Apr 28 05:52:00 devstack sudo[86271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Flow 'volume_create_manager' (a0799134-15bd-4c8b-990d-fdf5336dfae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79c01ea-4c8d-48fc-bcc4-6af688067d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79c01ea-4c8d-48fc-bcc4-6af688067d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-422894672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2670189-037b-4dd3-a332-3afab727ef09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09bccf08da604d97b114e948c497c495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:52:00Z,use_quota=True,user_id='c8dbc441054a453396906a3c2c3d3800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a27eec1-c02d-43df-9ad0-8f1ca4bd23b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a27eec1-c02d-43df-9ad0-8f1ca4bd23b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff1e0f89-a5f9-42e5-bec6-2095191658ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff1e0f89-a5f9-42e5-bec6-2095191658ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2670189-037b-4dd3-a332-3afab727ef09', 'volume_name': 'volume-a2670189-037b-4dd3-a332-3afab727ef09', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbde1017-245c-49ec-a679-fdc1ed03aebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbde1017-245c-49ec-a679-fdc1ed03aebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384ddef9-e781-44ea-8823-59b43a82eafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:00 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Volume a2670189-037b-4dd3-a332-3afab727ef09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2670189-037b-4dd3-a332-3afab727ef09', 'volume_size': 1} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-422894672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2670189-037b-4dd3-a332-3afab727ef09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09bccf08da604d97b114e948c497c495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:52:00Z,use_quota=True,user_id='c8dbc441054a453396906a3c2c3d3800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Creating volume a2670189-037b-4dd3-a332-3afab727ef09 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:52:00 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:52:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:00 devstack sudo[86273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09 1073741824 Apr 28 05:52:00 devstack sudo[86273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:01 devstack sudo[86271]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-de29ce87-ad22-45d7-bf34-8addc00b1953 tempest-AbsoluteLimitsTests-1360724911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a294e465-a189-47dc-93e9-fd66d3796120" returned: 0 in 0.686s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-de29ce87-ad22-45d7-bf34-8addc00b1953 tempest-AbsoluteLimitsTests-1360724911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a294e465-a189-47dc-93e9-fd66d3796120 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:01 devstack sudo[86279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a294e465-a189-47dc-93e9-fd66d3796120 Apr 28 05:52:01 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:01 devstack sudo[86273]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09 1073741824" returned: 0 in 0.968s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:01 devstack sudo[86288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09 Apr 28 05:52:01 devstack sudo[86288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:01 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-de29ce87-ad22-45d7-bf34-8addc00b1953 tempest-AbsoluteLimitsTests-1360724911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a294e465-a189-47dc-93e9-fd66d3796120" returned: 0 in 0.650s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-de29ce87-ad22-45d7-bf34-8addc00b1953 tempest-AbsoluteLimitsTests-1360724911 None] Lock "cinder-quobyte-a294e465-a189-47dc-93e9-fd66d3796120" released by "delete_volume" :: held 1.399s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:01 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-de29ce87-ad22-45d7-bf34-8addc00b1953 tempest-AbsoluteLimitsTests-1360724911 None] Created reservations ['43d43b1b-dd95-470a-a205-4649fa2c91d7', 'be96a227-562d-41f7-83d4-438c6b259bb6', '7819f35c-447f-41cc-996b-932218b968e6', 'e5734e7b-7d32-415f-bb70-4c33224e8c62'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:52:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-de29ce87-ad22-45d7-bf34-8addc00b1953 tempest-AbsoluteLimitsTests-1360724911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-de29ce87-ad22-45d7-bf34-8addc00b1953 tempest-AbsoluteLimitsTests-1360724911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-de29ce87-ad22-45d7-bf34-8addc00b1953 tempest-AbsoluteLimitsTests-1360724911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:52:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-de29ce87-ad22-45d7-bf34-8addc00b1953 tempest-AbsoluteLimitsTests-1360724911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:52:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-de29ce87-ad22-45d7-bf34-8addc00b1953 tempest-AbsoluteLimitsTests-1360724911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-de29ce87-ad22-45d7-bf34-8addc00b1953 tempest-AbsoluteLimitsTests-1360724911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:01 devstack sudo[86297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:52:01 devstack sudo[86297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:02 devstack sudo[86288]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09" returned: 0 in 0.504s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:02 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:52:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384ddef9-e781-44ea-8823-59b43a82eafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2670189-037b-4dd3-a332-3afab727ef09', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed56fbc8-782f-41b1-9f27-648eaf230be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:02 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Volume volume-a2670189-037b-4dd3-a332-3afab727ef09 (a2670189-037b-4dd3-a332-3afab727ef09): created successfully Apr 28 05:52:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed56fbc8-782f-41b1-9f27-648eaf230be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Flow 'volume_create_manager' (a0799134-15bd-4c8b-990d-fdf5336dfae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:52:02 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-6a9e318d-6e35-45cf-a503-8f6dd95523f1 tempest-VolumesDeleteCascade-1035242369 None] Created volume successfully. Apr 28 05:52:02 devstack sudo[86297]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-de29ce87-ad22-45d7-bf34-8addc00b1953 tempest-AbsoluteLimitsTests-1360724911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.558s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:02 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-de29ce87-ad22-45d7-bf34-8addc00b1953 tempest-AbsoluteLimitsTests-1360724911 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:52:02 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-de29ce87-ad22-45d7-bf34-8addc00b1953 tempest-AbsoluteLimitsTests-1360724911 None] Deleted volume successfully. Apr 28 05:52:02 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-de29ce87-ad22-45d7-bf34-8addc00b1953 tempest-AbsoluteLimitsTests-1360724911 None] Lock "cinder-a294e465-a189-47dc-93e9-fd66d3796120-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4436a492-0a0f-4279-b721-a902241cd76a tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4436a492-0a0f-4279-b721-a902241cd76a tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:03 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-4436a492-0a0f-4279-b721-a902241cd76a tempest-VolumesDeleteCascade-1035242369 None] Creating offline snapshot 1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb of volume a2670189-037b-4dd3-a332-3afab727ef09 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:52:03 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[08db7330-dd46-4edb-9394-328ad5c20077]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4436a492-0a0f-4279-b721-a902241cd76a tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:03 devstack sudo[86306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09 Apr 28 05:52:03 devstack sudo[86306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:03 devstack sudo[86306]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4436a492-0a0f-4279-b721-a902241cd76a tempest-VolumesDeleteCascade-1035242369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09" returned: 0 in 0.656s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4436a492-0a0f-4279-b721-a902241cd76a tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:03 devstack sudo[86311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb 1G Apr 28 05:52:03 devstack sudo[86311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:04 devstack sudo[86311]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4436a492-0a0f-4279-b721-a902241cd76a tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb 1G" returned: 0 in 0.857s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4436a492-0a0f-4279-b721-a902241cd76a tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2670189-037b-4dd3-a332-3afab727ef09 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:04 devstack sudo[86317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2670189-037b-4dd3-a332-3afab727ef09 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb Apr 28 05:52:04 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:05 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4436a492-0a0f-4279-b721-a902241cd76a tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2670189-037b-4dd3-a332-3afab727ef09 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb" returned: 0 in 0.780s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:05 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-4436a492-0a0f-4279-b721-a902241cd76a tempest-VolumesDeleteCascade-1035242369 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb is being set with open permissions: ugo+rw Apr 28 05:52:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4436a492-0a0f-4279-b721-a902241cd76a tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:05 devstack sudo[86323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb Apr 28 05:52:05 devstack sudo[86323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:06 devstack sudo[86323]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4436a492-0a0f-4279-b721-a902241cd76a tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb" returned: 0 in 0.648s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4436a492-0a0f-4279-b721-a902241cd76a tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:06 devstack sudo[86328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.info Apr 28 05:52:06 devstack sudo[86328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:06 devstack sudo[86328]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4436a492-0a0f-4279-b721-a902241cd76a tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.info" returned: 0 in 0.705s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:06 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-4436a492-0a0f-4279-b721-a902241cd76a tempest-VolumesDeleteCascade-1035242369 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.info is being set with open permissions: ugo+rw Apr 28 05:52:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4436a492-0a0f-4279-b721-a902241cd76a tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:06 devstack sudo[86338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.info Apr 28 05:52:06 devstack sudo[86338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:06 devstack cinder-volume[81829]: DEBUG oslo_service.periodic_task [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81829) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 05:52:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:52:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:52:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:07 devstack sudo[86342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:52:07 devstack sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:07 devstack sudo[86338]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4436a492-0a0f-4279-b721-a902241cd76a tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.info" returned: 0 in 0.905s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4436a492-0a0f-4279-b721-a902241cd76a tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.740s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:07 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-4436a492-0a0f-4279-b721-a902241cd76a tempest-VolumesDeleteCascade-1035242369 None] Create snapshot completed successfully Apr 28 05:52:07 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:52:07 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Flow 'volume_create_manager' (8c2376a1-ac19-4b04-9d93-da9da0897399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:52:07 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368aedef-ffa4-49d8-9387-165dc4284741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:07 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368aedef-ffa4-49d8-9387-165dc4284741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1587047469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30835fab-7bbb-4120-b7e8-4d30188bca13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36e5eb0ba0944240bfba0b2baf1d5371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:52:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:52:08Z,use_quota=True,user_id='9408ae2c94204ca6878a99591376bbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:07 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3243ca-bd03-4df2-b812-74d71565f2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:07 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3243ca-bd03-4df2-b812-74d71565f2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:07 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a96c145-de58-4b5a-b075-934445605de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:07 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a96c145-de58-4b5a-b075-934445605de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30835fab-7bbb-4120-b7e8-4d30188bca13', 'volume_name': 'volume-30835fab-7bbb-4120-b7e8-4d30188bca13', 'volume_size': 2}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:07 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7146ef62-4796-4618-8245-05bc76f01be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:07 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7146ef62-4796-4618-8245-05bc76f01be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:07 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a34fc40-dbd7-4a7d-91c8-b8b090764e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:08 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Volume 30835fab-7bbb-4120-b7e8-4d30188bca13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30835fab-7bbb-4120-b7e8-4d30188bca13', 'volume_size': 2} Apr 28 05:52:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1587047469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30835fab-7bbb-4120-b7e8-4d30188bca13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36e5eb0ba0944240bfba0b2baf1d5371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:52:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:52:08Z,use_quota=True,user_id='9408ae2c94204ca6878a99591376bbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:52:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Creating volume 30835fab-7bbb-4120-b7e8-4d30188bca13 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:52:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:52:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:52:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:52:08 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:52:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-30835fab-7bbb-4120-b7e8-4d30188bca13 2147483648 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:08 devstack sudo[86367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-30835fab-7bbb-4120-b7e8-4d30188bca13 2147483648 Apr 28 05:52:08 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:08 devstack sudo[86342]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 1.192s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:08 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:52:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d9734f2e-a8af-44c1-8059-86b99b221c52 tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:09 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-30835fab-7bbb-4120-b7e8-4d30188bca13 2147483648" returned: 0 in 1.285s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-30835fab-7bbb-4120-b7e8-4d30188bca13 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:09 devstack sudo[86390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-30835fab-7bbb-4120-b7e8-4d30188bca13 Apr 28 05:52:09 devstack sudo[86390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:09 devstack sudo[86390]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-30835fab-7bbb-4120-b7e8-4d30188bca13" returned: 0 in 0.556s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:52:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d9734f2e-a8af-44c1-8059-86b99b221c52 tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.125s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-d9734f2e-a8af-44c1-8059-86b99b221c52 tempest-VolumesDeleteCascade-1035242369 None] Creating offline snapshot a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4 of volume a2670189-037b-4dd3-a332-3afab727ef09 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:52:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a34fc40-dbd7-4a7d-91c8-b8b090764e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30835fab-7bbb-4120-b7e8-4d30188bca13', 'volume_size': 2}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9255ce4-8285-4373-8aeb-2c594bf5d506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:10 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d15504-9b62-4b5c-970d-63a859a9342f]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d9734f2e-a8af-44c1-8059-86b99b221c52 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:10 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Volume volume-30835fab-7bbb-4120-b7e8-4d30188bca13 (30835fab-7bbb-4120-b7e8-4d30188bca13): created successfully Apr 28 05:52:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9255ce4-8285-4373-8aeb-2c594bf5d506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Flow 'volume_create_manager' (8c2376a1-ac19-4b04-9d93-da9da0897399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:52:10 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-7e1c96c6-255f-4a78-a8a5-0825e249102b tempest-VolumesCloneNegativeTest-1494099199 None] Created volume successfully. Apr 28 05:52:10 devstack sudo[86393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb Apr 28 05:52:10 devstack sudo[86393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:11 devstack sudo[86393]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d9734f2e-a8af-44c1-8059-86b99b221c52 tempest-VolumesDeleteCascade-1035242369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb" returned: 0 in 1.139s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:11 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-d9734f2e-a8af-44c1-8059-86b99b221c52 tempest-VolumesDeleteCascade-1035242369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2670189-037b-4dd3-a332-3afab727ef09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:52:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d9734f2e-a8af-44c1-8059-86b99b221c52 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:11 devstack sudo[86402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4 1G Apr 28 05:52:11 devstack sudo[86402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:11 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-49417525-eb46-48d8-af97-6ff560e7482e tempest-VolumesCloneNegativeTest-1494099199 None] Acquiring lock "cinder-30835fab-7bbb-4120-b7e8-4d30188bca13-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:11 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-49417525-eb46-48d8-af97-6ff560e7482e tempest-VolumesCloneNegativeTest-1494099199 None] Lock "cinder-30835fab-7bbb-4120-b7e8-4d30188bca13-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:11 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-49417525-eb46-48d8-af97-6ff560e7482e tempest-VolumesCloneNegativeTest-1494099199 None] Acquiring lock "cinder-quobyte-30835fab-7bbb-4120-b7e8-4d30188bca13" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:11 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-49417525-eb46-48d8-af97-6ff560e7482e tempest-VolumesCloneNegativeTest-1494099199 None] Lock "cinder-quobyte-30835fab-7bbb-4120-b7e8-4d30188bca13" acquired by "delete_volume" :: waited 0.061s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:11 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb68513e-cf57-4cd5-8d3e-e9437f2b969e]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-49417525-eb46-48d8-af97-6ff560e7482e tempest-VolumesCloneNegativeTest-1494099199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-30835fab-7bbb-4120-b7e8-4d30188bca13 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:12 devstack sudo[86415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-30835fab-7bbb-4120-b7e8-4d30188bca13 Apr 28 05:52:12 devstack sudo[86415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:12 devstack sudo[86402]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d9734f2e-a8af-44c1-8059-86b99b221c52 tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4 1G" returned: 0 in 1.154s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d9734f2e-a8af-44c1-8059-86b99b221c52 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:12 devstack sudo[86420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4 Apr 28 05:52:12 devstack sudo[86420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:12 devstack sudo[86415]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-49417525-eb46-48d8-af97-6ff560e7482e tempest-VolumesCloneNegativeTest-1494099199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-30835fab-7bbb-4120-b7e8-4d30188bca13" returned: 0 in 1.044s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-49417525-eb46-48d8-af97-6ff560e7482e tempest-VolumesCloneNegativeTest-1494099199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-30835fab-7bbb-4120-b7e8-4d30188bca13 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:12 devstack sudo[86426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-30835fab-7bbb-4120-b7e8-4d30188bca13 Apr 28 05:52:12 devstack sudo[86426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:13 devstack sudo[86420]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d9734f2e-a8af-44c1-8059-86b99b221c52 tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4" returned: 0 in 1.029s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:13 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-d9734f2e-a8af-44c1-8059-86b99b221c52 tempest-VolumesDeleteCascade-1035242369 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4 is being set with open permissions: ugo+rw Apr 28 05:52:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d9734f2e-a8af-44c1-8059-86b99b221c52 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:13 devstack sudo[86432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4 Apr 28 05:52:13 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:13 devstack sudo[86426]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-49417525-eb46-48d8-af97-6ff560e7482e tempest-VolumesCloneNegativeTest-1494099199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-30835fab-7bbb-4120-b7e8-4d30188bca13" returned: 0 in 0.887s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:13 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-49417525-eb46-48d8-af97-6ff560e7482e tempest-VolumesCloneNegativeTest-1494099199 None] Lock "cinder-quobyte-30835fab-7bbb-4120-b7e8-4d30188bca13" released by "delete_volume" :: held 2.032s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:13 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d9734f2e-a8af-44c1-8059-86b99b221c52 tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4" returned: 0 in 0.619s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:14 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-49417525-eb46-48d8-af97-6ff560e7482e tempest-VolumesCloneNegativeTest-1494099199 None] Created reservations ['5b4812b8-1c0c-4e1f-ad95-ed8bc76d82d5', '7f6a9296-d1f7-4011-9007-1ddd1ae1203a', '67adb3d4-8af2-4db0-ad81-b8f090c7606e', '904a9d52-e223-44f0-a46b-e2b4ee53e472'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:52:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d9734f2e-a8af-44c1-8059-86b99b221c52 tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.154s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:14 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-d9734f2e-a8af-44c1-8059-86b99b221c52 tempest-VolumesDeleteCascade-1035242369 None] Create snapshot completed successfully Apr 28 05:52:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-49417525-eb46-48d8-af97-6ff560e7482e tempest-VolumesCloneNegativeTest-1494099199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-49417525-eb46-48d8-af97-6ff560e7482e tempest-VolumesCloneNegativeTest-1494099199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:14 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-49417525-eb46-48d8-af97-6ff560e7482e tempest-VolumesCloneNegativeTest-1494099199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:52:14 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-49417525-eb46-48d8-af97-6ff560e7482e tempest-VolumesCloneNegativeTest-1494099199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:52:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-49417525-eb46-48d8-af97-6ff560e7482e tempest-VolumesCloneNegativeTest-1494099199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-49417525-eb46-48d8-af97-6ff560e7482e tempest-VolumesCloneNegativeTest-1494099199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:14 devstack sudo[86444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:52:14 devstack sudo[86444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:14 devstack sudo[86444]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-49417525-eb46-48d8-af97-6ff560e7482e tempest-VolumesCloneNegativeTest-1494099199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.615s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:14 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-49417525-eb46-48d8-af97-6ff560e7482e tempest-VolumesCloneNegativeTest-1494099199 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:52:14 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-49417525-eb46-48d8-af97-6ff560e7482e tempest-VolumesCloneNegativeTest-1494099199 None] Deleted volume successfully. Apr 28 05:52:14 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-49417525-eb46-48d8-af97-6ff560e7482e tempest-VolumesCloneNegativeTest-1494099199 None] Lock "cinder-30835fab-7bbb-4120-b7e8-4d30188bca13-delete_volume" released by "delete_volume" :: held 3.172s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "cinder-a2670189-037b-4dd3-a332-3afab727ef09-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-a2670189-037b-4dd3-a332-3afab727ef09-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Performing cascade delete. {{(pid=81829) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 28 05:52:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "cinder-1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "cinder-quobyte-a2670189-037b-4dd3-a332-3afab727ef09" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-quobyte-a2670189-037b-4dd3-a332-3afab727ef09" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "cinder-quobyte-1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-quobyte-1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Deleting offline snapshot 1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb of volume a2670189-037b-4dd3-a332-3afab727ef09 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:52:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] snapshot_file for this snap is: volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:52:15 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4aa74b3-7b7c-46c6-9f30-fa0da05f5517]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:15 devstack sudo[86476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb Apr 28 05:52:15 devstack sudo[86476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:16 devstack sudo[86476]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb" returned: 0 in 0.725s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2670189-037b-4dd3-a332-3afab727ef09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:52:16 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[342ae0af-320d-4f3b-b1ab-e95538d8b420]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:16 devstack sudo[86489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09 Apr 28 05:52:16 devstack sudo[86489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:17 devstack sudo[86489]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09" returned: 0 in 0.832s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:17 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[9044f824-62b1-4a7c-8f9c-87d3a4484b28]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:17 devstack sudo[86519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4 Apr 28 05:52:17 devstack sudo[86519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:18 devstack sudo[86519]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4" returned: 0 in 0.875s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2670189-037b-4dd3-a332-3afab727ef09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fef05bc-07dd-482d-bd7f-52e488a2ed5a]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:18 devstack sudo[86524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb Apr 28 05:52:18 devstack sudo[86524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Flow 'volume_create_manager' (41c99d77-bc5e-4489-80bc-eedf53b69840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162c354a-29b3-4909-b7f3-c202b4ca3b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162c354a-29b3-4909-b7f3-c202b4ca3b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-975296693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5737eda1-856f-411e-9560-c333fc5add3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e5b95fe0de4f56adee6c26b3957ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:52:19Z,use_quota=True,user_id='3c1afa62c3fe431585e4e72420ad8720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6318b5bb-3fb2-4ff6-b4a7-8ccbcd686c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6318b5bb-3fb2-4ff6-b4a7-8ccbcd686c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c953ce-1e9a-4d8a-83e3-9f267af81f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c953ce-1e9a-4d8a-83e3-9f267af81f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5737eda1-856f-411e-9560-c333fc5add3b', 'volume_name': 'volume-5737eda1-856f-411e-9560-c333fc5add3b', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c6e9c2-99f5-486d-98b4-d504441f3a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c6e9c2-99f5-486d-98b4-d504441f3a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (362a3486-b08d-4404-a95b-032775c5aa05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:18 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Volume 5737eda1-856f-411e-9560-c333fc5add3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5737eda1-856f-411e-9560-c333fc5add3b', 'volume_size': 1} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-975296693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5737eda1-856f-411e-9560-c333fc5add3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e5b95fe0de4f56adee6c26b3957ea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:52:19Z,use_quota=True,user_id='3c1afa62c3fe431585e4e72420ad8720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Creating volume 5737eda1-856f-411e-9560-c333fc5add3b {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:52:18 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:52:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5737eda1-856f-411e-9560-c333fc5add3b 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:19 devstack sudo[86524]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb" returned: 0 in 0.968s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:19 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2670189-037b-4dd3-a332-3afab727ef09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:52:19 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[c763da3d-5931-45ad-ab6c-67eaa780f57e]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:19 devstack sudo[86530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5737eda1-856f-411e-9560-c333fc5add3b 1073741824 Apr 28 05:52:19 devstack sudo[86530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:19 devstack sudo[86539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09 Apr 28 05:52:19 devstack sudo[86539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:20 devstack sudo[86530]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5737eda1-856f-411e-9560-c333fc5add3b 1073741824" returned: 0 in 1.726s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5737eda1-856f-411e-9560-c333fc5add3b {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:20 devstack sudo[86539]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09" returned: 0 in 1.845s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:20 devstack sudo[86580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5737eda1-856f-411e-9560-c333fc5add3b Apr 28 05:52:20 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:20 devstack sudo[86582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb Apr 28 05:52:20 devstack sudo[86582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:21 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5737eda1-856f-411e-9560-c333fc5add3b" returned: 0 in 0.690s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] <== create_volume: return (2574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:52:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.580s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (362a3486-b08d-4404-a95b-032775c5aa05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5737eda1-856f-411e-9560-c333fc5add3b', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f7e2581-0019-426a-8475-5e146b921fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:21 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Volume volume-5737eda1-856f-411e-9560-c333fc5add3b (5737eda1-856f-411e-9560-c333fc5add3b): created successfully Apr 28 05:52:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f7e2581-0019-426a-8475-5e146b921fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Flow 'volume_create_manager' (41c99d77-bc5e-4489-80bc-eedf53b69840) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:52:21 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-d5f5e926-547e-41e1-98da-6212e40c605f tempest-VolumesNegativeTest-2064406691 None] Created volume successfully. Apr 28 05:52:21 devstack sudo[86582]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb" returned: 0 in 1.088s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:22 devstack sudo[86621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb Apr 28 05:52:22 devstack sudo[86621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:22 devstack sudo[86621]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb" returned: 0 in 0.795s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2670189-037b-4dd3-a332-3afab727ef09 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4 -F qcow2 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:22 devstack sudo[86632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2670189-037b-4dd3-a332-3afab727ef09 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4 -F qcow2 Apr 28 05:52:22 devstack sudo[86632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:23 devstack sudo[86632]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2670189-037b-4dd3-a332-3afab727ef09 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4 -F qcow2" returned: 0 in 0.601s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-quobyte-1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb" released by "_delete_snapshot" :: held 7.980s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-quobyte-a2670189-037b-4dd3-a332-3afab727ef09" released by "delete_snapshot" :: held 8.034s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:23 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Created reservations ['9d8972a5-b761-4a72-99ce-0ad5c14826ae', 'a0e460ab-7f7c-4945-9e45-ab2059339624', '26166726-fb37-4861-9442-c9a7b309fa77', '1558ac38-52a7-40bd-8112-43f41884d386'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:52:23 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Delete snapshot completed successfully. Apr 28 05:52:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-1025a4c8-69ca-4bfc-9367-8fc0ed9bb0fb-delete_snapshot" released by "delete_snapshot" :: held 8.232s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "cinder-a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "cinder-quobyte-a2670189-037b-4dd3-a332-3afab727ef09" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-quobyte-a2670189-037b-4dd3-a332-3afab727ef09" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "cinder-quobyte-a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-quobyte-a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:23 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Deleting offline snapshot a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4 of volume a2670189-037b-4dd3-a332-3afab727ef09 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:52:23 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] snapshot_file for this snap is: volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:52:23 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[85233445-1502-492e-adb2-f9cddb5689ce]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:23 devstack sudo[86640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4 Apr 28 05:52:23 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:24 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4" returned: 0 in 0.715s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:24 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2670189-037b-4dd3-a332-3afab727ef09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:52:24 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3be9566-cd6a-4263-b469-13a0f5fe8880]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:24 devstack cinder-volume[81829]: INFO cinder.volume.manager [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-ea4515b8-d698-4726-bf55-d23d82b95aab tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Terminate volume connection completed successfully. Apr 28 05:52:24 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-ea4515b8-d698-4726-bf55-d23d82b95aab tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Deleting attachment ee290ed5-ac28-49a3-a7a9-33220262c7e5. {{(pid=81829) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 28 05:52:24 devstack sudo[86651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09 Apr 28 05:52:24 devstack sudo[86651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:25 devstack sudo[86651]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09" returned: 0 in 0.576s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:25 devstack sudo[86657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4 Apr 28 05:52:25 devstack sudo[86657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Acquiring lock "cinder-26ef5a8c-86cb-41d4-adab-d67334d93a84-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "cinder-26ef5a8c-86cb-41d4-adab-d67334d93a84-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Acquiring lock "cinder-quobyte-26ef5a8c-86cb-41d4-adab-d67334d93a84" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "cinder-quobyte-26ef5a8c-86cb-41d4-adab-d67334d93a84" acquired by "delete_volume" :: waited 0.026s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:25 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57c342a-39f1-431f-b79e-aec6725b9ef7]: (4, 'raw') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:25 devstack sudo[86660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 Apr 28 05:52:25 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:25 devstack sudo[86657]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4" returned: 0 in 0.804s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:25 devstack sudo[86665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4 Apr 28 05:52:25 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:25 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84" returned: 0 in 0.577s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:26 devstack sudo[86669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 Apr 28 05:52:26 devstack sudo[86669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:26 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09.a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4" returned: 0 in 0.529s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-quobyte-a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4" released by "_delete_snapshot" :: held 2.781s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-quobyte-a2670189-037b-4dd3-a332-3afab727ef09" released by "delete_snapshot" :: held 2.806s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:26 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Created reservations ['c5bfdaf2-9e98-4895-a772-cb18038d9b1a', '4699a390-610a-4161-a444-35b0b5641850', '110f3b98-10fa-4121-80f4-89441d349c6a', '342869a3-0fa5-4ad7-8529-05ace55c534d'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:52:26 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Delete snapshot completed successfully. Apr 28 05:52:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-a5ee6c54-e08a-45b8-9e5c-51bae0ff48a4-delete_snapshot" released by "delete_snapshot" :: held 2.972s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Snapshots deleted, issuing volume delete {{(pid=81829) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 28 05:52:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "cinder-quobyte-a2670189-037b-4dd3-a332-3afab727ef09" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-quobyte-a2670189-037b-4dd3-a332-3afab727ef09" acquired by "delete_volume" :: waited 0.010s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:26 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f83457-3300-4b64-8003-d1e042062ded]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:26 devstack sudo[86669]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84" returned: 1 in 0.680s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84' failed. Not Retrying. {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 05:52:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:26 devstack sudo[86680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84 Apr 28 05:52:26 devstack sudo[86680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:26 devstack sudo[86679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09 Apr 28 05:52:26 devstack sudo[86679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:27 devstack sudo[86680]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-26ef5a8c-86cb-41d4-adab-d67334d93a84" returned: 0 in 0.497s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "cinder-quobyte-26ef5a8c-86cb-41d4-adab-d67334d93a84" released by "delete_volume" :: held 1.819s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:27 devstack sudo[86679]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09" returned: 0 in 0.609s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:27 devstack sudo[86687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09 Apr 28 05:52:27 devstack sudo[86687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG cinder.quota [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Created reservations ['660e083c-85af-430f-9dba-fa98379401c8', 'f78ed2e6-1d9d-404f-8845-0e9136bc05d8', 'fec23ddc-1fff-4b48-aa72-7945a6a237f6', 'ace92685-076a-44a6-8099-fffadc00706e'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:27 devstack sudo[86689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:52:27 devstack sudo[86689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:27 devstack sudo[86687]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-a2670189-037b-4dd3-a332-3afab727ef09" returned: 0 in 0.489s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-quobyte-a2670189-037b-4dd3-a332-3afab727ef09" released by "delete_volume" :: held 1.158s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Created reservations ['52e0028b-a53f-47e4-b4ba-b8db3db0426a', '95fbd45c-edc5-4caa-88d4-ea85a887c52d', '14a19907-e211-4c09-bf6b-0a990dd87b69', '203c1228-269e-4f06-a5d2-a5922347b26a'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:52:27 devstack sudo[86689]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.512s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG cinder.manager [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:52:27 devstack cinder-volume[81829]: INFO cinder.volume.manager [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Deleted volume successfully. Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-39bcbb13-9aef-434a-a295-7909bdc918aa req-c030558a-2fa8-4598-81f5-48103595ab92 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "cinder-26ef5a8c-86cb-41d4-adab-d67334d93a84-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:27 devstack sudo[86693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:52:27 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:28 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.664s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:28 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:52:28 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Deleted volume successfully. Apr 28 05:52:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b9b98ca8-8224-4fdc-a239-1bd408db4d55 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-a2670189-037b-4dd3-a332-3afab727ef09-delete_volume" released by "delete_volume" :: held 13.396s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:29 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:52:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Flow 'volume_create_manager' (2940c79f-4fd6-484d-8497-80c7ebf89e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:52:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48182b31-61c3-418e-b4b0-35761b1bebfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48182b31-61c3-418e-b4b0-35761b1bebfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-658564223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202cf35f-9fdd-4bdb-a749-09ab84dbc643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09bccf08da604d97b114e948c497c495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:52:29Z,use_quota=True,user_id='c8dbc441054a453396906a3c2c3d3800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b7e358-2833-40f3-a224-33765a215777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b7e358-2833-40f3-a224-33765a215777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe302c7a-20ba-48d3-9c3c-450a9e42257a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe302c7a-20ba-48d3-9c3c-450a9e42257a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '202cf35f-9fdd-4bdb-a749-09ab84dbc643', 'volume_name': 'volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15376ac1-b34e-436b-9363-a42f5191e9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15376ac1-b34e-436b-9363-a42f5191e9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87bbfbf-cb62-42e1-ad85-5a5ad9f4c157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:29 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Volume 202cf35f-9fdd-4bdb-a749-09ab84dbc643: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643', 'volume_size': 1} Apr 28 05:52:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-658564223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202cf35f-9fdd-4bdb-a749-09ab84dbc643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09bccf08da604d97b114e948c497c495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:52:29Z,use_quota=True,user_id='c8dbc441054a453396906a3c2c3d3800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:52:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Creating volume 202cf35f-9fdd-4bdb-a749-09ab84dbc643 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:52:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:52:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:52:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:52:29 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:52:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:29 devstack sudo[86725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 1073741824 Apr 28 05:52:29 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:30 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 1073741824" returned: 0 in 1.166s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:30 devstack sudo[86752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 Apr 28 05:52:30 devstack sudo[86752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:31 devstack sudo[86752]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643" returned: 0 in 0.924s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] <== create_volume: return (2151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:52:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.153s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87bbfbf-cb62-42e1-ad85-5a5ad9f4c157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7453b65-9ba0-4305-b7d2-07337a0bffca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:31 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Volume volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 (202cf35f-9fdd-4bdb-a749-09ab84dbc643): created successfully Apr 28 05:52:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7453b65-9ba0-4305-b7d2-07337a0bffca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Flow 'volume_create_manager' (2940c79f-4fd6-484d-8497-80c7ebf89e9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:52:31 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-569f0776-69c7-4039-af1a-d0b4bb6e959f tempest-VolumesDeleteCascade-1035242369 None] Created volume successfully. Apr 28 05:52:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4c2fb0ae-1112-433b-a899-9b6b24bc486b tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4c2fb0ae-1112-433b-a899-9b6b24bc486b tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-4c2fb0ae-1112-433b-a899-9b6b24bc486b tempest-VolumesDeleteCascade-1035242369 None] Creating offline snapshot 92ea7cbb-ff26-4086-87c5-47b6b0d4573f of volume 202cf35f-9fdd-4bdb-a749-09ab84dbc643 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:52:33 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[030fa62f-a96a-4cc6-bc0f-9ce88840d866]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4c2fb0ae-1112-433b-a899-9b6b24bc486b tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:33 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:52:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Flow 'volume_create_manager' (8f89b436-6685-4515-97e8-538c3273d3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:52:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da1fc9e-42ec-4818-92e1-503f3624534f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da1fc9e-42ec-4818-92e1-503f3624534f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1019811961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b35f73-39dd-455a-9023-7bd705813774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60185b1cc53480482300b7052922989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:52:33Z,use_quota=True,user_id='281c2c64fd424ad99f061e6d212b60c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af754d9b-6a8a-458b-983b-9f77445ffc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:33 devstack sudo[86781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 Apr 28 05:52:33 devstack sudo[86781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af754d9b-6a8a-458b-983b-9f77445ffc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9531d696-7a39-47cf-96ce-bb38ecec7a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9531d696-7a39-47cf-96ce-bb38ecec7a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6b35f73-39dd-455a-9023-7bd705813774', 'volume_name': 'volume-c6b35f73-39dd-455a-9023-7bd705813774', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005da442-b887-4584-a360-73ff15d2497d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005da442-b887-4584-a360-73ff15d2497d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a817d8ec-7fef-470c-bb06-f1e62a1a2fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:33 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Volume c6b35f73-39dd-455a-9023-7bd705813774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6b35f73-39dd-455a-9023-7bd705813774', 'volume_size': 1} Apr 28 05:52:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:34 devstack sudo[86781]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4c2fb0ae-1112-433b-a899-9b6b24bc486b tempest-VolumesDeleteCascade-1035242369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643" returned: 0 in 1.334s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4c2fb0ae-1112-433b-a899-9b6b24bc486b tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:34 devstack sudo[86805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f 1G Apr 28 05:52:34 devstack sudo[86805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:35 devstack sudo[86805]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4c2fb0ae-1112-433b-a899-9b6b24bc486b tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f 1G" returned: 0 in 0.806s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4c2fb0ae-1112-433b-a899-9b6b24bc486b tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:35 devstack sudo[86812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f Apr 28 05:52:35 devstack sudo[86812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:36 devstack sudo[86812]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4c2fb0ae-1112-433b-a899-9b6b24bc486b tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f" returned: 0 in 0.724s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:36 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-4c2fb0ae-1112-433b-a899-9b6b24bc486b tempest-VolumesDeleteCascade-1035242369 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f is being set with open permissions: ugo+rw Apr 28 05:52:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4c2fb0ae-1112-433b-a899-9b6b24bc486b tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:36 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f Apr 28 05:52:36 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:36 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4c2fb0ae-1112-433b-a899-9b6b24bc486b tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f" returned: 0 in 0.508s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4c2fb0ae-1112-433b-a899-9b6b24bc486b tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:36 devstack sudo[86826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.info Apr 28 05:52:36 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:37 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4c2fb0ae-1112-433b-a899-9b6b24bc486b tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.info" returned: 0 in 0.578s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:37 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-4c2fb0ae-1112-433b-a899-9b6b24bc486b tempest-VolumesDeleteCascade-1035242369 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.info is being set with open permissions: ugo+rw Apr 28 05:52:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4c2fb0ae-1112-433b-a899-9b6b24bc486b tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:37 devstack sudo[86829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.info Apr 28 05:52:37 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:37 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4c2fb0ae-1112-433b-a899-9b6b24bc486b tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.info" returned: 0 in 0.584s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4c2fb0ae-1112-433b-a899-9b6b24bc486b tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.710s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.130s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:37 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1019811961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b35f73-39dd-455a-9023-7bd705813774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60185b1cc53480482300b7052922989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:52:33Z,use_quota=True,user_id='281c2c64fd424ad99f061e6d212b60c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:52:37 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Creating volume c6b35f73-39dd-455a-9023-7bd705813774 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:52:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:37 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:52:37 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:52:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:37 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:52:37 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:52:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6b35f73-39dd-455a-9023-7bd705813774 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:37 devstack sudo[86838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6b35f73-39dd-455a-9023-7bd705813774 1073741824 Apr 28 05:52:37 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:37 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-4c2fb0ae-1112-433b-a899-9b6b24bc486b tempest-VolumesDeleteCascade-1035242369 None] Create snapshot completed successfully Apr 28 05:52:39 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6b35f73-39dd-455a-9023-7bd705813774 1073741824" returned: 0 in 1.265s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6b35f73-39dd-455a-9023-7bd705813774 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:39 devstack sudo[86866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6b35f73-39dd-455a-9023-7bd705813774 Apr 28 05:52:39 devstack sudo[86866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:39 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:52:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Flow 'volume_create_manager' (bc320a05-2c28-43e2-af24-51dd26807560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:52:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b0b9cb0-249c-42d0-bd5e-5c2b05b8279b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b0b9cb0-249c-42d0-bd5e-5c2b05b8279b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-825060214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af83ca5e-03f2-4641-a2be-4d968d1a01eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09bccf08da604d97b114e948c497c495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=92ea7cbb-ff26-4086-87c5-47b6b0d4573f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:52:39Z,use_quota=True,user_id='c8dbc441054a453396906a3c2c3d3800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed736b28-43a8-4559-b4c8-3581fef9de8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed736b28-43a8-4559-b4c8-3581fef9de8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e7aaf0-c8c9-415d-9e4a-25863b1c5c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e7aaf0-c8c9-415d-9e4a-25863b1c5c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'af83ca5e-03f2-4641-a2be-4d968d1a01eb', 'volume_name': 'volume-af83ca5e-03f2-4641-a2be-4d968d1a01eb', 'volume_size': 1, 'snapshot_id': '92ea7cbb-ff26-4086-87c5-47b6b0d4573f'}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106adf66-ef79-454a-bdbf-45614981c833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106adf66-ef79-454a-bdbf-45614981c833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567e218c-693b-45e7-8044-78f06a4f5e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:39 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Volume af83ca5e-03f2-4641-a2be-4d968d1a01eb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-af83ca5e-03f2-4641-a2be-4d968d1a01eb', 'volume_size': 1, 'snapshot_id': '92ea7cbb-ff26-4086-87c5-47b6b0d4573f'} Apr 28 05:52:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:40 devstack sudo[86866]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6b35f73-39dd-455a-9023-7bd705813774" returned: 0 in 0.932s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.264s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.615s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "cinder-quobyte-92ea7cbb-ff26-4086-87c5-47b6b0d4573f-af83ca5e-03f2-4641-a2be-4d968d1a01eb" by "_create_volume_from_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-quobyte-92ea7cbb-ff26-4086-87c5-47b6b0d4573f-af83ca5e-03f2-4641-a2be-4d968d1a01eb" acquired by "_create_volume_from_snapshot" :: waited 0.058s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Creating volume af83ca5e-03f2-4641-a2be-4d968d1a01eb from snapshot 92ea7cbb-ff26-4086-87c5-47b6b0d4573f {{(pid=81829) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "cinder-quobyte-af83ca5e-03f2-4641-a2be-4d968d1a01eb" by "_copy_volume_from_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a817d8ec-7fef-470c-bb06-f1e62a1a2fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6b35f73-39dd-455a-9023-7bd705813774', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d2e441-d59c-424b-ac8f-bc562ad777c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:40 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Volume volume-c6b35f73-39dd-455a-9023-7bd705813774 (c6b35f73-39dd-455a-9023-7bd705813774): created successfully Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d2e441-d59c-424b-ac8f-bc562ad777c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Flow 'volume_create_manager' (8f89b436-6685-4515-97e8-538c3273d3d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-quobyte-af83ca5e-03f2-4641-a2be-4d968d1a01eb" acquired by "_copy_volume_from_snapshot" :: waited 0.098s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] snapshot: 92ea7cbb-ff26-4086-87c5-47b6b0d4573f, volume: af83ca5e-03f2-4641-a2be-4d968d1a01eb, {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 05:52:40 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-e18b0876-af72-4989-abc1-988f669fe5fd tempest-VolumesActionsTest-1383043696 None] Created volume successfully. Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[474d4013-6560-42f3-ae38-943b9ffd300b]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:40 devstack sudo[86886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f Apr 28 05:52:40 devstack sudo[86886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:41 devstack sudo[86886]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f" returned: 0 in 0.826s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:41 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:52:41 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] will copy from snapshot at /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 05:52:41 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Creating direct copy from snapshot {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 05:52:41 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[84378b23-62e7-4cd3-874f-52b03c7cc9d8]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:41 devstack sudo[86894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 Apr 28 05:52:41 devstack sudo[86894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:41 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3daf6ea6-94c2-4d0c-8b01-d275db56d8d7 tempest-VolumesActionsTest-1383043696 None] Acquiring lock "cinder-c6b35f73-39dd-455a-9023-7bd705813774" by "attach_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:41 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3daf6ea6-94c2-4d0c-8b01-d275db56d8d7 tempest-VolumesActionsTest-1383043696 None] Lock "cinder-c6b35f73-39dd-455a-9023-7bd705813774" acquired by "attach_volume" :: waited 0.041s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:41 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-3daf6ea6-94c2-4d0c-8b01-d275db56d8d7 tempest-VolumesActionsTest-1383043696 None] Attaching volume c6b35f73-39dd-455a-9023-7bd705813774 to instance 5bbc7a22-9a01-4a97-a1b0-e572a2d77550 at mountpoint /dev/vdb on host None. Apr 28 05:52:42 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-3daf6ea6-94c2-4d0c-8b01-d275db56d8d7 tempest-VolumesActionsTest-1383043696 None] Attach volume completed successfully. Apr 28 05:52:42 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3daf6ea6-94c2-4d0c-8b01-d275db56d8d7 tempest-VolumesActionsTest-1383043696 None] Lock "cinder-c6b35f73-39dd-455a-9023-7bd705813774" released by "attach_volume" :: held 0.373s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:43 devstack sudo[86894]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643" returned: 0 in 1.690s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:43 devstack cinder-volume[81829]: DEBUG cinder.utils [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Path /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-af83ca5e-03f2-4641-a2be-4d968d1a01eb not found in is_blk_device check {{(pid=81829) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 05:52:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-af83ca5e-03f2-4641-a2be-4d968d1a01eb {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:43 devstack sudo[86976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-af83ca5e-03f2-4641-a2be-4d968d1a01eb Apr 28 05:52:43 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:43 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-de87fbaa-1c8c-44a3-81b3-2a49803ca137 tempest-VolumesActionsTest-71890540 None] Terminate volume connection completed successfully. Apr 28 05:52:43 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-de87fbaa-1c8c-44a3-81b3-2a49803ca137 tempest-VolumesActionsTest-71890540 None] Acquiring lock "cinder-c6b35f73-39dd-455a-9023-7bd705813774-detach_volume" by "detach_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:43 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-de87fbaa-1c8c-44a3-81b3-2a49803ca137 tempest-VolumesActionsTest-71890540 None] Lock "cinder-c6b35f73-39dd-455a-9023-7bd705813774-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:44 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-de87fbaa-1c8c-44a3-81b3-2a49803ca137 tempest-VolumesActionsTest-71890540 None] Detaching volume c6b35f73-39dd-455a-9023-7bd705813774 from instance 5bbc7a22-9a01-4a97-a1b0-e572a2d77550. Apr 28 05:52:44 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-de87fbaa-1c8c-44a3-81b3-2a49803ca137 tempest-VolumesActionsTest-71890540 None] Detach volume completed successfully. Apr 28 05:52:44 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-de87fbaa-1c8c-44a3-81b3-2a49803ca137 tempest-VolumesActionsTest-71890540 None] Lock "cinder-c6b35f73-39dd-455a-9023-7bd705813774-detach_volume" released by "detach_volume" :: held 0.145s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:44 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4736fd9f-680c-4f78-9220-f1f8639bef5a tempest-VolumesActionsTest-1383043696 None] Acquiring lock "cinder-c6b35f73-39dd-455a-9023-7bd705813774-detach_volume" by "detach_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:44 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4736fd9f-680c-4f78-9220-f1f8639bef5a tempest-VolumesActionsTest-1383043696 None] Lock "cinder-c6b35f73-39dd-455a-9023-7bd705813774-detach_volume" acquired by "detach_volume" :: waited 0.072s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:45 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-4736fd9f-680c-4f78-9220-f1f8639bef5a tempest-VolumesActionsTest-1383043696 None] Volume detach called, but volume not attached. Apr 28 05:52:45 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4736fd9f-680c-4f78-9220-f1f8639bef5a tempest-VolumesActionsTest-1383043696 None] Lock "cinder-c6b35f73-39dd-455a-9023-7bd705813774-detach_volume" released by "detach_volume" :: held 0.098s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:45 devstack cinder-volume[81829]: INFO cinder.volume.manager [req-f6ddd62d-47eb-4909-904f-754e78931bd8 req-c06507cf-8bfd-4d1f-815e-75ed3cd50002 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Terminate volume connection completed successfully. Apr 28 05:52:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-f6ddd62d-47eb-4909-904f-754e78931bd8 req-c06507cf-8bfd-4d1f-815e-75ed3cd50002 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Deleting attachment 6e7783e2-966b-4075-894f-6620dbe56181. {{(pid=81829) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 28 05:52:45 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6d3c7cdd-eda2-4e0f-80a0-4724b929c594 tempest-VolumesActionsTest-1383043696 None] Acquiring lock "cinder-c6b35f73-39dd-455a-9023-7bd705813774-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:45 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6d3c7cdd-eda2-4e0f-80a0-4724b929c594 tempest-VolumesActionsTest-1383043696 None] Lock "cinder-c6b35f73-39dd-455a-9023-7bd705813774-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:46 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6d3c7cdd-eda2-4e0f-80a0-4724b929c594 tempest-VolumesActionsTest-1383043696 None] Acquiring lock "cinder-quobyte-c6b35f73-39dd-455a-9023-7bd705813774" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:46 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6d3c7cdd-eda2-4e0f-80a0-4724b929c594 tempest-VolumesActionsTest-1383043696 None] Lock "cinder-quobyte-c6b35f73-39dd-455a-9023-7bd705813774" acquired by "delete_volume" :: waited 0.035s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:46 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e4ba66-9d1d-46a0-9192-b2d2579b9456]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6d3c7cdd-eda2-4e0f-80a0-4724b929c594 tempest-VolumesActionsTest-1383043696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6b35f73-39dd-455a-9023-7bd705813774 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:46 devstack sudo[87015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6b35f73-39dd-455a-9023-7bd705813774 Apr 28 05:52:46 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:46 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-f6ddd62d-47eb-4909-904f-754e78931bd8 req-692c9dd1-bf40-4f5a-8375-8f13ea673641 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Acquiring lock "cinder-0e442449-d92d-44f5-91a4-1645d5e95a7e-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:46 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-f6ddd62d-47eb-4909-904f-754e78931bd8 req-692c9dd1-bf40-4f5a-8375-8f13ea673641 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "cinder-0e442449-d92d-44f5-91a4-1645d5e95a7e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:46 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-f6ddd62d-47eb-4909-904f-754e78931bd8 req-692c9dd1-bf40-4f5a-8375-8f13ea673641 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Acquiring lock "cinder-quobyte-0e442449-d92d-44f5-91a4-1645d5e95a7e" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:46 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-f6ddd62d-47eb-4909-904f-754e78931bd8 req-692c9dd1-bf40-4f5a-8375-8f13ea673641 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "cinder-quobyte-0e442449-d92d-44f5-91a4-1645d5e95a7e" acquired by "delete_volume" :: waited 0.026s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:46 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[20111e8a-8967-4145-b136-46f98a7f8172]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-f6ddd62d-47eb-4909-904f-754e78931bd8 req-692c9dd1-bf40-4f5a-8375-8f13ea673641 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e442449-d92d-44f5-91a4-1645d5e95a7e {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:46 devstack sudo[87019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e442449-d92d-44f5-91a4-1645d5e95a7e Apr 28 05:52:47 devstack sudo[87019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:47 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6d3c7cdd-eda2-4e0f-80a0-4724b929c594 tempest-VolumesActionsTest-1383043696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6b35f73-39dd-455a-9023-7bd705813774" returned: 0 in 1.265s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6d3c7cdd-eda2-4e0f-80a0-4724b929c594 tempest-VolumesActionsTest-1383043696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6b35f73-39dd-455a-9023-7bd705813774 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:47 devstack sudo[87025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6b35f73-39dd-455a-9023-7bd705813774 Apr 28 05:52:47 devstack sudo[87025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:48 devstack sudo[87019]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-f6ddd62d-47eb-4909-904f-754e78931bd8 req-692c9dd1-bf40-4f5a-8375-8f13ea673641 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e442449-d92d-44f5-91a4-1645d5e95a7e" returned: 0 in 1.645s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-f6ddd62d-47eb-4909-904f-754e78931bd8 req-692c9dd1-bf40-4f5a-8375-8f13ea673641 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e442449-d92d-44f5-91a4-1645d5e95a7e {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:48 devstack sudo[87032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e442449-d92d-44f5-91a4-1645d5e95a7e Apr 28 05:52:48 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:48 devstack sudo[87025]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6d3c7cdd-eda2-4e0f-80a0-4724b929c594 tempest-VolumesActionsTest-1383043696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6b35f73-39dd-455a-9023-7bd705813774" returned: 0 in 1.270s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:48 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6d3c7cdd-eda2-4e0f-80a0-4724b929c594 tempest-VolumesActionsTest-1383043696 None] Lock "cinder-quobyte-c6b35f73-39dd-455a-9023-7bd705813774" released by "delete_volume" :: held 2.696s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:48 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-6d3c7cdd-eda2-4e0f-80a0-4724b929c594 tempest-VolumesActionsTest-1383043696 None] Created reservations ['4816abfc-76a6-4df0-921d-c6d0d5f38a57', '9b05b26b-d406-4718-b364-351e096713cc', '53b3a564-c216-4071-9622-3e87b378b9b9', '5b57d365-592a-41ac-bf34-7975c05d0537'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:52:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6d3c7cdd-eda2-4e0f-80a0-4724b929c594 tempest-VolumesActionsTest-1383043696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6d3c7cdd-eda2-4e0f-80a0-4724b929c594 tempest-VolumesActionsTest-1383043696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:48 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6d3c7cdd-eda2-4e0f-80a0-4724b929c594 tempest-VolumesActionsTest-1383043696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:52:48 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6d3c7cdd-eda2-4e0f-80a0-4724b929c594 tempest-VolumesActionsTest-1383043696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:52:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6d3c7cdd-eda2-4e0f-80a0-4724b929c594 tempest-VolumesActionsTest-1383043696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6d3c7cdd-eda2-4e0f-80a0-4724b929c594 tempest-VolumesActionsTest-1383043696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:49 devstack sudo[87035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:52:49 devstack sudo[87035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:49 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-f6ddd62d-47eb-4909-904f-754e78931bd8 req-692c9dd1-bf40-4f5a-8375-8f13ea673641 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e442449-d92d-44f5-91a4-1645d5e95a7e" returned: 0 in 1.089s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:49 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-f6ddd62d-47eb-4909-904f-754e78931bd8 req-692c9dd1-bf40-4f5a-8375-8f13ea673641 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "cinder-quobyte-0e442449-d92d-44f5-91a4-1645d5e95a7e" released by "delete_volume" :: held 2.861s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:49 devstack cinder-volume[81829]: DEBUG cinder.quota [req-f6ddd62d-47eb-4909-904f-754e78931bd8 req-692c9dd1-bf40-4f5a-8375-8f13ea673641 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Created reservations ['a41dedc3-513e-41f1-a179-39542c5f8665', '652026eb-c227-4849-9842-34b418c346bc', '1cf5482b-294d-41c6-a271-ea9b69f26c6d', '2782412e-27df-4882-86f1-22dade65001e'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:52:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-f6ddd62d-47eb-4909-904f-754e78931bd8 req-692c9dd1-bf40-4f5a-8375-8f13ea673641 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-f6ddd62d-47eb-4909-904f-754e78931bd8 req-692c9dd1-bf40-4f5a-8375-8f13ea673641 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:49 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-f6ddd62d-47eb-4909-904f-754e78931bd8 req-692c9dd1-bf40-4f5a-8375-8f13ea673641 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:52:49 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-f6ddd62d-47eb-4909-904f-754e78931bd8 req-692c9dd1-bf40-4f5a-8375-8f13ea673641 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:52:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-f6ddd62d-47eb-4909-904f-754e78931bd8 req-692c9dd1-bf40-4f5a-8375-8f13ea673641 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-f6ddd62d-47eb-4909-904f-754e78931bd8 req-692c9dd1-bf40-4f5a-8375-8f13ea673641 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:49 devstack sudo[87038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:52:49 devstack sudo[87038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:50 devstack sudo[87035]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6d3c7cdd-eda2-4e0f-80a0-4724b929c594 tempest-VolumesActionsTest-1383043696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 1.924s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:50 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-6d3c7cdd-eda2-4e0f-80a0-4724b929c594 tempest-VolumesActionsTest-1383043696 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:52:50 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-6d3c7cdd-eda2-4e0f-80a0-4724b929c594 tempest-VolumesActionsTest-1383043696 None] Deleted volume successfully. Apr 28 05:52:51 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6d3c7cdd-eda2-4e0f-80a0-4724b929c594 tempest-VolumesActionsTest-1383043696 None] Lock "cinder-c6b35f73-39dd-455a-9023-7bd705813774-delete_volume" released by "delete_volume" :: held 5.197s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:51 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-af83ca5e-03f2-4641-a2be-4d968d1a01eb" returned: 0 in 8.468s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:51 devstack sudo[87038]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-f6ddd62d-47eb-4909-904f-754e78931bd8 req-692c9dd1-bf40-4f5a-8375-8f13ea673641 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 1.761s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:51 devstack cinder-volume[81829]: DEBUG cinder.manager [req-f6ddd62d-47eb-4909-904f-754e78931bd8 req-692c9dd1-bf40-4f5a-8375-8f13ea673641 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:52:51 devstack cinder-volume[81829]: INFO cinder.volume.manager [req-f6ddd62d-47eb-4909-904f-754e78931bd8 req-692c9dd1-bf40-4f5a-8375-8f13ea673641 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Deleted volume successfully. Apr 28 05:52:51 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[916f7957-a8ca-4e26-b239-881a7a5e1bba]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:51 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-f6ddd62d-47eb-4909-904f-754e78931bd8 req-692c9dd1-bf40-4f5a-8375-8f13ea673641 tempest-ServerBootFromVolumeStableRescueTest-1159439409 None] Lock "cinder-0e442449-d92d-44f5-91a4-1645d5e95a7e-delete_volume" released by "delete_volume" :: held 5.090s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:51 devstack sudo[87069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 Apr 28 05:52:51 devstack sudo[87069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:52 devstack sudo[87069]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643" returned: 0 in 1.148s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:52 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Image conversion details: src /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643, size 1024.00 MB, duration 8.47 sec, destination /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-af83ca5e-03f2-4641-a2be-4d968d1a01eb {{(pid=81829) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:52:52 devstack cinder-volume[81829]: INFO cinder.image.image_utils [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Converted 1024.00 MB image at 120.91 MB/s Apr 28 05:52:52 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-af83ca5e-03f2-4641-a2be-4d968d1a01eb is being set with open permissions: ugo+rw Apr 28 05:52:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-af83ca5e-03f2-4641-a2be-4d968d1a01eb {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:52 devstack sudo[87092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-af83ca5e-03f2-4641-a2be-4d968d1a01eb Apr 28 05:52:52 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:53 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-af83ca5e-03f2-4641-a2be-4d968d1a01eb" returned: 0 in 0.602s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:53 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-quobyte-af83ca5e-03f2-4641-a2be-4d968d1a01eb" released by "_copy_volume_from_snapshot" :: held 12.940s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:53 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-quobyte-92ea7cbb-ff26-4086-87c5-47b6b0d4573f-af83ca5e-03f2-4641-a2be-4d968d1a01eb" released by "_create_volume_from_snapshot" :: held 13.082s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.142s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:53 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567e218c-693b-45e7-8044-78f06a4f5e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af83ca5e-03f2-4641-a2be-4d968d1a01eb', 'volume_size': 1, 'snapshot_id': '92ea7cbb-ff26-4086-87c5-47b6b0d4573f'}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:53 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ff15e4-79ac-410c-a10f-9ac9f5a41f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:53 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Volume volume-af83ca5e-03f2-4641-a2be-4d968d1a01eb (af83ca5e-03f2-4641-a2be-4d968d1a01eb): created successfully Apr 28 05:52:53 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ff15e4-79ac-410c-a10f-9ac9f5a41f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:53 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Flow 'volume_create_manager' (bc320a05-2c28-43e2-af24-51dd26807560) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:52:53 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-2f9b4550-ae82-40dd-9424-08af8698940e tempest-VolumesDeleteCascade-1035242369 None] Created volume successfully. Apr 28 05:52:53 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:SELECT=78,cinder:UPDATE=88,cinder:INSERT=22,cinder:DELETE=7 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:52:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "cinder-202cf35f-9fdd-4bdb-a749-09ab84dbc643-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-202cf35f-9fdd-4bdb-a749-09ab84dbc643-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:54 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:SELECT=72,cinder:UPDATE=86,cinder:DELETE=9,cinder:INSERT=20 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:52:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Performing cascade delete. {{(pid=81829) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 28 05:52:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "cinder-92ea7cbb-ff26-4086-87c5-47b6b0d4573f-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-92ea7cbb-ff26-4086-87c5-47b6b0d4573f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "cinder-quobyte-202cf35f-9fdd-4bdb-a749-09ab84dbc643" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-quobyte-202cf35f-9fdd-4bdb-a749-09ab84dbc643" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "cinder-quobyte-92ea7cbb-ff26-4086-87c5-47b6b0d4573f" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-quobyte-92ea7cbb-ff26-4086-87c5-47b6b0d4573f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Deleting offline snapshot 92ea7cbb-ff26-4086-87c5-47b6b0d4573f of volume 202cf35f-9fdd-4bdb-a749-09ab84dbc643 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:52:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] snapshot_file for this snap is: volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:52:54 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec13ba8-29c7-41e0-b443-e666812773b6]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:54 devstack sudo[87121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f Apr 28 05:52:54 devstack sudo[87121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:55 devstack sudo[87121]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f" returned: 0 in 0.741s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:55 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:52:55 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[7765c60b-c996-44f8-9592-ab2366b6762f]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:55 devstack sudo[87129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 Apr 28 05:52:55 devstack sudo[87129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:55 devstack sudo[87129]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643" returned: 0 in 0.630s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:55 devstack sudo[87135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f Apr 28 05:52:55 devstack sudo[87135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:56 devstack sudo[87135]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f" returned: 0 in 0.700s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:56 devstack sudo[87142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f Apr 28 05:52:56 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:57 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643.92ea7cbb-ff26-4086-87c5-47b6b0d4573f" returned: 0 in 0.551s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-quobyte-92ea7cbb-ff26-4086-87c5-47b6b0d4573f" released by "_delete_snapshot" :: held 2.739s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-quobyte-202cf35f-9fdd-4bdb-a749-09ab84dbc643" released by "delete_snapshot" :: held 2.777s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Created reservations ['32d3b504-0fe9-4824-9cb1-fd1af4c4c1f5', 'a5e27569-2df5-4a78-9fa3-6b5721a7850e', 'aada6b52-6811-49a0-91d3-e6052dc46e33', '6074d364-6166-4211-be4d-b2f0a739fde3'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:52:57 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Delete snapshot completed successfully. Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-92ea7cbb-ff26-4086-87c5-47b6b0d4573f-delete_snapshot" released by "delete_snapshot" :: held 3.051s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Snapshots deleted, issuing volume delete {{(pid=81829) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "cinder-quobyte-202cf35f-9fdd-4bdb-a749-09ab84dbc643" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-quobyte-202cf35f-9fdd-4bdb-a749-09ab84dbc643" acquired by "delete_volume" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Flow 'volume_create_manager' (6f609018-dfc8-4d03-8b27-d6b07096295a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baeb972e-fb31-48e2-bddb-946e4060287e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[49705559-3c2a-4b1f-88cf-2fb1a8b39b57]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baeb972e-fb31-48e2-bddb-946e4060287e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-152019154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60185b1cc53480482300b7052922989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:52:57Z,use_quota=True,user_id='281c2c64fd424ad99f061e6d212b60c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9bc51d-c0d9-4282-92ab-32595b78e727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9bc51d-c0d9-4282-92ab-32595b78e727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb53f07b-9dcd-454f-83c6-0c5119651239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb53f07b-9dcd-454f-83c6-0c5119651239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f', 'volume_name': 'volume-12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503cebe3-17cf-424b-9944-9f76d862145c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503cebe3-17cf-424b-9944-9f76d862145c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8663a0fe-5dac-4c61-9082-92387a618910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:57 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Volume 12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f', 'volume_size': 1} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-152019154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60185b1cc53480482300b7052922989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:52:57Z,use_quota=True,user_id='281c2c64fd424ad99f061e6d212b60c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Creating volume 12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:52:57 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:52:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:57 devstack sudo[87145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 Apr 28 05:52:57 devstack sudo[87145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:57 devstack sudo[87146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f 1073741824 Apr 28 05:52:57 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:58 devstack sudo[87145]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643" returned: 0 in 0.590s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:58 devstack sudo[87155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643 Apr 28 05:52:58 devstack sudo[87155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:58 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f 1073741824" returned: 0 in 0.729s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:58 devstack sudo[87157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f Apr 28 05:52:58 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:58 devstack sudo[87155]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-202cf35f-9fdd-4bdb-a749-09ab84dbc643" returned: 0 in 0.650s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-quobyte-202cf35f-9fdd-4bdb-a749-09ab84dbc643" released by "delete_volume" :: held 1.332s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:58 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Created reservations ['76a4a08e-b03f-47aa-914c-0211f9ca6568', '7d604fcd-ad98-4b81-af41-a0b760892887', '23f4df03-bdbd-451d-aca9-dfcef968b1bb', 'f2cd35d9-4770-45ba-9751-367a581c9bca'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:52:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:52:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:52:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:52:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:52:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:58 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f" returned: 0 in 0.543s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:52:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:52:58 devstack sudo[87161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:52:58 devstack sudo[87161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:52:58 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8663a0fe-5dac-4c61-9082-92387a618910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:58 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9033d3a8-cc81-42c6-9bb1-d1410732001e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:52:58 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Volume volume-12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f (12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f): created successfully Apr 28 05:52:58 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9033d3a8-cc81-42c6-9bb1-d1410732001e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:52:58 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Flow 'volume_create_manager' (6f609018-dfc8-4d03-8b27-d6b07096295a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:52:58 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-60204ca2-f373-483a-9558-c506968e36b8 tempest-VolumesActionsTest-1383043696 None] Created volume successfully. Apr 28 05:52:59 devstack sudo[87161]: pam_unix(sudo:session): session closed for user root Apr 28 05:52:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.548s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:52:59 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:52:59 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Deleted volume successfully. Apr 28 05:52:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e52fdfb5-cebe-4f8d-aad8-074dd412a0c9 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-202cf35f-9fdd-4bdb-a749-09ab84dbc643-delete_volume" released by "delete_volume" :: held 5.191s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:52:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-58a23c50-464c-444d-9fcf-6b25a6cffac5 tempest-VolumesActionsTest-71890540 None] Acquiring lock "cinder-12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-58a23c50-464c-444d-9fcf-6b25a6cffac5 tempest-VolumesActionsTest-71890540 None] Lock "cinder-12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-58a23c50-464c-444d-9fcf-6b25a6cffac5 tempest-VolumesActionsTest-71890540 None] Acquiring lock "cinder-quobyte-12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-58a23c50-464c-444d-9fcf-6b25a6cffac5 tempest-VolumesActionsTest-71890540 None] Lock "cinder-quobyte-12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f" acquired by "delete_volume" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:52:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-15983ab7-4901-4419-8b6a-6291c78b6a77 tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "cinder-af83ca5e-03f2-4641-a2be-4d968d1a01eb-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:52:59 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[8905f459-f5d2-454b-b470-1ee07c2b7b37]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:52:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-58a23c50-464c-444d-9fcf-6b25a6cffac5 tempest-VolumesActionsTest-71890540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:52:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-15983ab7-4901-4419-8b6a-6291c78b6a77 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-af83ca5e-03f2-4641-a2be-4d968d1a01eb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:00 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-15983ab7-4901-4419-8b6a-6291c78b6a77 tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "cinder-quobyte-af83ca5e-03f2-4641-a2be-4d968d1a01eb" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:00 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-15983ab7-4901-4419-8b6a-6291c78b6a77 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-quobyte-af83ca5e-03f2-4641-a2be-4d968d1a01eb" acquired by "delete_volume" :: waited 0.026s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:00 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe864d1-6b1d-4e65-87f8-44ddadd5e4b0]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:53:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-15983ab7-4901-4419-8b6a-6291c78b6a77 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-af83ca5e-03f2-4641-a2be-4d968d1a01eb {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:00 devstack sudo[87164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f Apr 28 05:53:00 devstack sudo[87164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:00 devstack sudo[87165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-af83ca5e-03f2-4641-a2be-4d968d1a01eb Apr 28 05:53:00 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:00 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0c43692d-3d57-49f5-a8b2-a3eb67f91ea5 tempest-VolumesNegativeTest-2064406691 None] Acquiring lock "cinder-5737eda1-856f-411e-9560-c333fc5add3b-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:00 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0c43692d-3d57-49f5-a8b2-a3eb67f91ea5 tempest-VolumesNegativeTest-2064406691 None] Lock "cinder-5737eda1-856f-411e-9560-c333fc5add3b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:00 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0c43692d-3d57-49f5-a8b2-a3eb67f91ea5 tempest-VolumesNegativeTest-2064406691 None] Acquiring lock "cinder-quobyte-5737eda1-856f-411e-9560-c333fc5add3b" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:00 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0c43692d-3d57-49f5-a8b2-a3eb67f91ea5 tempest-VolumesNegativeTest-2064406691 None] Lock "cinder-quobyte-5737eda1-856f-411e-9560-c333fc5add3b" acquired by "delete_volume" :: waited 0.022s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:00 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46568ff-b42f-4927-af7e-4f864788dd96]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:53:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0c43692d-3d57-49f5-a8b2-a3eb67f91ea5 tempest-VolumesNegativeTest-2064406691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5737eda1-856f-411e-9560-c333fc5add3b {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:00 devstack sudo[87168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5737eda1-856f-411e-9560-c333fc5add3b Apr 28 05:53:00 devstack sudo[87168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:00 devstack sudo[87164]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-58a23c50-464c-444d-9fcf-6b25a6cffac5 tempest-VolumesActionsTest-71890540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f" returned: 0 in 0.809s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-58a23c50-464c-444d-9fcf-6b25a6cffac5 tempest-VolumesActionsTest-71890540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:00 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-15983ab7-4901-4419-8b6a-6291c78b6a77 tempest-VolumesDeleteCascade-1035242369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-af83ca5e-03f2-4641-a2be-4d968d1a01eb" returned: 0 in 0.688s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-15983ab7-4901-4419-8b6a-6291c78b6a77 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-af83ca5e-03f2-4641-a2be-4d968d1a01eb {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:00 devstack sudo[87177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f Apr 28 05:53:00 devstack sudo[87177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:00 devstack sudo[87178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-af83ca5e-03f2-4641-a2be-4d968d1a01eb Apr 28 05:53:00 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:00 devstack sudo[87168]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0c43692d-3d57-49f5-a8b2-a3eb67f91ea5 tempest-VolumesNegativeTest-2064406691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5737eda1-856f-411e-9560-c333fc5add3b" returned: 0 in 0.651s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0c43692d-3d57-49f5-a8b2-a3eb67f91ea5 tempest-VolumesNegativeTest-2064406691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5737eda1-856f-411e-9560-c333fc5add3b {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:01 devstack sudo[87184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5737eda1-856f-411e-9560-c333fc5add3b Apr 28 05:53:01 devstack sudo[87184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:01 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-15983ab7-4901-4419-8b6a-6291c78b6a77 tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-af83ca5e-03f2-4641-a2be-4d968d1a01eb" returned: 0 in 0.526s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-15983ab7-4901-4419-8b6a-6291c78b6a77 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-quobyte-af83ca5e-03f2-4641-a2be-4d968d1a01eb" released by "delete_volume" :: held 1.270s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:01 devstack sudo[87177]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-58a23c50-464c-444d-9fcf-6b25a6cffac5 tempest-VolumesActionsTest-71890540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f" returned: 0 in 0.612s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-58a23c50-464c-444d-9fcf-6b25a6cffac5 tempest-VolumesActionsTest-71890540 None] Lock "cinder-quobyte-12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f" released by "delete_volume" :: held 1.480s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-15983ab7-4901-4419-8b6a-6291c78b6a77 tempest-VolumesDeleteCascade-1035242369 None] Created reservations ['dc4731e8-d3fe-4608-add2-586d345e2c3e', '7458a342-2c5b-4786-9578-79dad0633a1e', '675069c8-2c40-4aaa-866c-efc74a3dba58', 'b95e35e5-7f4d-4697-b2f1-d3da4228a96a'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-58a23c50-464c-444d-9fcf-6b25a6cffac5 tempest-VolumesActionsTest-71890540 None] Created reservations ['5afe61c7-48ea-4749-8e12-08b2b5825977', 'e1286376-3515-49f6-9e5b-7568a2cdae97', 'd53ca3ca-7594-45bc-be31-077c2d4681c1', 'ba9d9e80-05d6-4388-a1f2-27594892a972'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-15983ab7-4901-4419-8b6a-6291c78b6a77 tempest-VolumesDeleteCascade-1035242369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-15983ab7-4901-4419-8b6a-6291c78b6a77 tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-15983ab7-4901-4419-8b6a-6291c78b6a77 tempest-VolumesDeleteCascade-1035242369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:01 devstack sudo[87184]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-15983ab7-4901-4419-8b6a-6291c78b6a77 tempest-VolumesDeleteCascade-1035242369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-15983ab7-4901-4419-8b6a-6291c78b6a77 tempest-VolumesDeleteCascade-1035242369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-15983ab7-4901-4419-8b6a-6291c78b6a77 tempest-VolumesDeleteCascade-1035242369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0c43692d-3d57-49f5-a8b2-a3eb67f91ea5 tempest-VolumesNegativeTest-2064406691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5737eda1-856f-411e-9560-c333fc5add3b" returned: 0 in 0.603s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:01 devstack sudo[87190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:53:01 devstack sudo[87190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0c43692d-3d57-49f5-a8b2-a3eb67f91ea5 tempest-VolumesNegativeTest-2064406691 None] Lock "cinder-quobyte-5737eda1-856f-411e-9560-c333fc5add3b" released by "delete_volume" :: held 1.300s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-58a23c50-464c-444d-9fcf-6b25a6cffac5 tempest-VolumesActionsTest-71890540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-58a23c50-464c-444d-9fcf-6b25a6cffac5 tempest-VolumesActionsTest-71890540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-58a23c50-464c-444d-9fcf-6b25a6cffac5 tempest-VolumesActionsTest-71890540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-58a23c50-464c-444d-9fcf-6b25a6cffac5 tempest-VolumesActionsTest-71890540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-58a23c50-464c-444d-9fcf-6b25a6cffac5 tempest-VolumesActionsTest-71890540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-58a23c50-464c-444d-9fcf-6b25a6cffac5 tempest-VolumesActionsTest-71890540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:01 devstack sudo[87192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:53:01 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-0c43692d-3d57-49f5-a8b2-a3eb67f91ea5 tempest-VolumesNegativeTest-2064406691 None] Created reservations ['88b399f0-2fcd-41bf-979c-a3b264a3680d', 'e3a311be-466f-4a23-acd0-9733b442b909', '92d81217-2642-4bd7-a561-ab7cde7d00ca', '26f37363-9554-4438-880a-f2554adfa320'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0c43692d-3d57-49f5-a8b2-a3eb67f91ea5 tempest-VolumesNegativeTest-2064406691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0c43692d-3d57-49f5-a8b2-a3eb67f91ea5 tempest-VolumesNegativeTest-2064406691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-0c43692d-3d57-49f5-a8b2-a3eb67f91ea5 tempest-VolumesNegativeTest-2064406691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-0c43692d-3d57-49f5-a8b2-a3eb67f91ea5 tempest-VolumesNegativeTest-2064406691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0c43692d-3d57-49f5-a8b2-a3eb67f91ea5 tempest-VolumesNegativeTest-2064406691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0c43692d-3d57-49f5-a8b2-a3eb67f91ea5 tempest-VolumesNegativeTest-2064406691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:01 devstack sudo[87194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:53:01 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:02 devstack sudo[87190]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-15983ab7-4901-4419-8b6a-6291c78b6a77 tempest-VolumesDeleteCascade-1035242369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.463s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-15983ab7-4901-4419-8b6a-6291c78b6a77 tempest-VolumesDeleteCascade-1035242369 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:53:02 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-15983ab7-4901-4419-8b6a-6291c78b6a77 tempest-VolumesDeleteCascade-1035242369 None] Deleted volume successfully. Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-15983ab7-4901-4419-8b6a-6291c78b6a77 tempest-VolumesDeleteCascade-1035242369 None] Lock "cinder-af83ca5e-03f2-4641-a2be-4d968d1a01eb-delete_volume" released by "delete_volume" :: held 2.084s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:02 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-58a23c50-464c-444d-9fcf-6b25a6cffac5 tempest-VolumesActionsTest-71890540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.572s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-58a23c50-464c-444d-9fcf-6b25a6cffac5 tempest-VolumesActionsTest-71890540 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:53:02 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-58a23c50-464c-444d-9fcf-6b25a6cffac5 tempest-VolumesActionsTest-71890540 None] Deleted volume successfully. Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-58a23c50-464c-444d-9fcf-6b25a6cffac5 tempest-VolumesActionsTest-71890540 None] Lock "cinder-12ce5bc1-0ce3-4e55-a275-8a1bd9f7798f-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:02 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0c43692d-3d57-49f5-a8b2-a3eb67f91ea5 tempest-VolumesNegativeTest-2064406691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.579s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-0c43692d-3d57-49f5-a8b2-a3eb67f91ea5 tempest-VolumesNegativeTest-2064406691 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:53:02 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-0c43692d-3d57-49f5-a8b2-a3eb67f91ea5 tempest-VolumesNegativeTest-2064406691 None] Deleted volume successfully. Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0c43692d-3d57-49f5-a8b2-a3eb67f91ea5 tempest-VolumesNegativeTest-2064406691 None] Lock "cinder-5737eda1-856f-411e-9560-c333fc5add3b-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Flow 'volume_create_manager' (6ef59bf1-c82b-481a-9688-9e26ef30a477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f365fe4e-1f73-40c9-ba26-bafbe7233447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f365fe4e-1f73-40c9-ba26-bafbe7233447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-741534345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f455e5ad-cee7-42b2-babe-73733edc36cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60185b1cc53480482300b7052922989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:03Z,use_quota=True,user_id='281c2c64fd424ad99f061e6d212b60c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df687012-ec82-483f-9536-4235740c6360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df687012-ec82-483f-9536-4235740c6360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb54e5d-69ed-4d01-9ea1-125ba9ce689f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb54e5d-69ed-4d01-9ea1-125ba9ce689f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f455e5ad-cee7-42b2-babe-73733edc36cc', 'volume_name': 'volume-f455e5ad-cee7-42b2-babe-73733edc36cc', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d7a3ed-d3fd-4e78-b16b-8d1057d48327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d7a3ed-d3fd-4e78-b16b-8d1057d48327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc64f319-f3f2-4c34-95c4-bf40769b29a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:02 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Volume f455e5ad-cee7-42b2-babe-73733edc36cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f455e5ad-cee7-42b2-babe-73733edc36cc', 'volume_size': 1} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-741534345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f455e5ad-cee7-42b2-babe-73733edc36cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60185b1cc53480482300b7052922989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:03Z,use_quota=True,user_id='281c2c64fd424ad99f061e6d212b60c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Creating volume f455e5ad-cee7-42b2-babe-73733edc36cc {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:53:02 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:53:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f455e5ad-cee7-42b2-babe-73733edc36cc 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:02 devstack sudo[87199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f455e5ad-cee7-42b2-babe-73733edc36cc 1073741824 Apr 28 05:53:02 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:03 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f455e5ad-cee7-42b2-babe-73733edc36cc 1073741824" returned: 0 in 0.849s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f455e5ad-cee7-42b2-babe-73733edc36cc {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:03 devstack sudo[87204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f455e5ad-cee7-42b2-babe-73733edc36cc Apr 28 05:53:03 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:04 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f455e5ad-cee7-42b2-babe-73733edc36cc" returned: 0 in 0.619s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:04 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:53:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc64f319-f3f2-4c34-95c4-bf40769b29a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f455e5ad-cee7-42b2-babe-73733edc36cc', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c095daf0-29fd-4d81-9e9c-afd1084770b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:04 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Volume volume-f455e5ad-cee7-42b2-babe-73733edc36cc (f455e5ad-cee7-42b2-babe-73733edc36cc): created successfully Apr 28 05:53:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c095daf0-29fd-4d81-9e9c-afd1084770b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Flow 'volume_create_manager' (6ef59bf1-c82b-481a-9688-9e26ef30a477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:04 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-66e333d0-7820-495a-a09e-079430f4d847 tempest-VolumesActionsTest-1383043696 None] Created volume successfully. Apr 28 05:53:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5f100bca-44d6-42b8-9556-2d13d6284b27 tempest-VolumesActionsTest-71890540 None] Acquiring lock "cinder-f455e5ad-cee7-42b2-babe-73733edc36cc-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5f100bca-44d6-42b8-9556-2d13d6284b27 tempest-VolumesActionsTest-71890540 None] Lock "cinder-f455e5ad-cee7-42b2-babe-73733edc36cc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5f100bca-44d6-42b8-9556-2d13d6284b27 tempest-VolumesActionsTest-71890540 None] Acquiring lock "cinder-quobyte-f455e5ad-cee7-42b2-babe-73733edc36cc" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5f100bca-44d6-42b8-9556-2d13d6284b27 tempest-VolumesActionsTest-71890540 None] Lock "cinder-quobyte-f455e5ad-cee7-42b2-babe-73733edc36cc" acquired by "delete_volume" :: waited 0.019s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:05 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1b8976-5bea-4b7e-9a86-7e8bed8028cb]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:53:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5f100bca-44d6-42b8-9556-2d13d6284b27 tempest-VolumesActionsTest-71890540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f455e5ad-cee7-42b2-babe-73733edc36cc {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:05 devstack sudo[87208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f455e5ad-cee7-42b2-babe-73733edc36cc Apr 28 05:53:05 devstack sudo[87208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:05 devstack sudo[87208]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5f100bca-44d6-42b8-9556-2d13d6284b27 tempest-VolumesActionsTest-71890540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f455e5ad-cee7-42b2-babe-73733edc36cc" returned: 0 in 0.617s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5f100bca-44d6-42b8-9556-2d13d6284b27 tempest-VolumesActionsTest-71890540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f455e5ad-cee7-42b2-babe-73733edc36cc {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:05 devstack sudo[87213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f455e5ad-cee7-42b2-babe-73733edc36cc Apr 28 05:53:05 devstack sudo[87213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:06 devstack sudo[87213]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5f100bca-44d6-42b8-9556-2d13d6284b27 tempest-VolumesActionsTest-71890540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f455e5ad-cee7-42b2-babe-73733edc36cc" returned: 0 in 0.520s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5f100bca-44d6-42b8-9556-2d13d6284b27 tempest-VolumesActionsTest-71890540 None] Lock "cinder-quobyte-f455e5ad-cee7-42b2-babe-73733edc36cc" released by "delete_volume" :: held 1.197s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-5f100bca-44d6-42b8-9556-2d13d6284b27 tempest-VolumesActionsTest-71890540 None] Created reservations ['5b943132-549e-454e-b32f-b08421235d78', 'cc9be29b-8c4b-467a-bdc2-40d6002968ee', '3dc09105-af9e-4aa5-831f-64d66e6ba28e', '29261ca1-abe8-49b1-b06e-b0824410c88e'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5f100bca-44d6-42b8-9556-2d13d6284b27 tempest-VolumesActionsTest-71890540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5f100bca-44d6-42b8-9556-2d13d6284b27 tempest-VolumesActionsTest-71890540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5f100bca-44d6-42b8-9556-2d13d6284b27 tempest-VolumesActionsTest-71890540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5f100bca-44d6-42b8-9556-2d13d6284b27 tempest-VolumesActionsTest-71890540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5f100bca-44d6-42b8-9556-2d13d6284b27 tempest-VolumesActionsTest-71890540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5f100bca-44d6-42b8-9556-2d13d6284b27 tempest-VolumesActionsTest-71890540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:06 devstack sudo[87216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:53:06 devstack sudo[87216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Flow 'volume_create_manager' (b6f1ec68-7adc-46ce-b580-7cc66cd22bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c4c372b-eb4a-4d9d-a96d-187cee46972e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c4c372b-eb4a-4d9d-a96d-187cee46972e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2049856471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4052ca57-336e-4bb3-b6c5-1e611aef2627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722b0d5af8ae43f1ab298b1508b1728e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:07Z,use_quota=True,user_id='cad0c77938ee440a90fd719dbd6781e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ac496a1-a35b-49af-88c0-bb0a2ea58896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ac496a1-a35b-49af-88c0-bb0a2ea58896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68dfe05d-fa5c-444d-9549-e8193a9385ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68dfe05d-fa5c-444d-9549-e8193a9385ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4052ca57-336e-4bb3-b6c5-1e611aef2627', 'volume_name': 'volume-4052ca57-336e-4bb3-b6c5-1e611aef2627', 'volume_size': 2}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47b9bcd-6cff-4150-a293-fa09574a5fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47b9bcd-6cff-4150-a293-fa09574a5fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca02e104-23b1-4716-9641-4fde360be01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:06 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Volume 4052ca57-336e-4bb3-b6c5-1e611aef2627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4052ca57-336e-4bb3-b6c5-1e611aef2627', 'volume_size': 2} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2049856471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4052ca57-336e-4bb3-b6c5-1e611aef2627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722b0d5af8ae43f1ab298b1508b1728e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:07Z,use_quota=True,user_id='cad0c77938ee440a90fd719dbd6781e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Creating volume 4052ca57-336e-4bb3-b6c5-1e611aef2627 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:53:06 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627 2147483648 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:06 devstack sudo[87218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627 2147483648 Apr 28 05:53:06 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG oslo_service.periodic_task [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81829) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:06 devstack sudo[87221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:53:06 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:07 devstack sudo[87216]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5f100bca-44d6-42b8-9556-2d13d6284b27 tempest-VolumesActionsTest-71890540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.656s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:07 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-5f100bca-44d6-42b8-9556-2d13d6284b27 tempest-VolumesActionsTest-71890540 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:53:07 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-5f100bca-44d6-42b8-9556-2d13d6284b27 tempest-VolumesActionsTest-71890540 None] Deleted volume successfully. Apr 28 05:53:07 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5f100bca-44d6-42b8-9556-2d13d6284b27 tempest-VolumesActionsTest-71890540 None] Lock "cinder-f455e5ad-cee7-42b2-babe-73733edc36cc-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:07 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.733s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:07 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:53:07 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627 2147483648" returned: 0 in 1.048s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:07 devstack sudo[87227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627 Apr 28 05:53:07 devstack sudo[87227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:07 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Flow 'volume_create_manager' (d399516a-b73d-42a7-9a47-d18b0ec6ee6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9300629-b210-4bd6-9cee-903a12158d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9300629-b210-4bd6-9cee-903a12158d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-824597091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb71fb6-c945-46a7-b842-0ba8bf010b3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60185b1cc53480482300b7052922989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:08Z,use_quota=True,user_id='281c2c64fd424ad99f061e6d212b60c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e7cd5b0-26f3-44b7-a661-b799c50169f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e7cd5b0-26f3-44b7-a661-b799c50169f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0584c00-349b-4a54-909b-dc51fe4b765b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0584c00-349b-4a54-909b-dc51fe4b765b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeb71fb6-c945-46a7-b842-0ba8bf010b3e', 'volume_name': 'volume-aeb71fb6-c945-46a7-b842-0ba8bf010b3e', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95906ea9-1403-4b0c-8dde-74677f6cdc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95906ea9-1403-4b0c-8dde-74677f6cdc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba61d16e-92c0-45b3-bc35-26f5fb1dec59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:08 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Volume aeb71fb6-c945-46a7-b842-0ba8bf010b3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeb71fb6-c945-46a7-b842-0ba8bf010b3e', 'volume_size': 1} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Flow 'volume_create_manager' (898ab5da-70ff-4af6-8c3f-30d6cb41af84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe96542-cac2-4d39-b0e0-9e9e3ba38a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe96542-cac2-4d39-b0e0-9e9e3ba38a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-627209892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d015af7-de83-4994-83c7-4abe74a0cbb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12d6f236d9b4d968ffd3beeb2cf7b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:08Z,use_quota=True,user_id='50776d8b6b1a411e928225d29cb940f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1382a93-99e9-4f9d-b257-00e6d024200e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1382a93-99e9-4f9d-b257-00e6d024200e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (712f8055-844f-4d91-ba04-31e84f02d36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (712f8055-844f-4d91-ba04-31e84f02d36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d015af7-de83-4994-83c7-4abe74a0cbb0', 'volume_name': 'volume-4d015af7-de83-4994-83c7-4abe74a0cbb0', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8dc84ba-66b4-4591-8242-60a6329340dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8dc84ba-66b4-4591-8242-60a6329340dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ed2b6b-f946-4819-95cf-a86701bea83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:08 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Volume 4d015af7-de83-4994-83c7-4abe74a0cbb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d015af7-de83-4994-83c7-4abe74a0cbb0', 'volume_size': 1} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:08 devstack sudo[87227]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627" returned: 0 in 0.577s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.281s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-824597091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb71fb6-c945-46a7-b842-0ba8bf010b3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60185b1cc53480482300b7052922989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:08Z,use_quota=True,user_id='281c2c64fd424ad99f061e6d212b60c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Creating volume aeb71fb6-c945-46a7-b842-0ba8bf010b3e {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:53:08 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-aeb71fb6-c945-46a7-b842-0ba8bf010b3e 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca02e104-23b1-4716-9641-4fde360be01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4052ca57-336e-4bb3-b6c5-1e611aef2627', 'volume_size': 2}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:08 devstack sudo[87232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-aeb71fb6-c945-46a7-b842-0ba8bf010b3e 1073741824 Apr 28 05:53:08 devstack sudo[87232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384ddc53-f1fd-4870-bc42-73c5bb53bafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:08 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Volume volume-4052ca57-336e-4bb3-b6c5-1e611aef2627 (4052ca57-336e-4bb3-b6c5-1e611aef2627): created successfully Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384ddc53-f1fd-4870-bc42-73c5bb53bafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Flow 'volume_create_manager' (b6f1ec68-7adc-46ce-b580-7cc66cd22bc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:08 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-7ffec306-dc05-4043-a24f-bc608ac7f61c tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Created volume successfully. Apr 28 05:53:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-65834a20-aa8a-4dcd-b0e8-66eafa606ab3 tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:09 devstack sudo[87232]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-aeb71fb6-c945-46a7-b842-0ba8bf010b3e 1073741824" returned: 0 in 0.887s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-aeb71fb6-c945-46a7-b842-0ba8bf010b3e {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:09 devstack sudo[87239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-aeb71fb6-c945-46a7-b842-0ba8bf010b3e Apr 28 05:53:09 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:09 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-aeb71fb6-c945-46a7-b842-0ba8bf010b3e" returned: 0 in 0.502s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:53:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.598s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-627209892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d015af7-de83-4994-83c7-4abe74a0cbb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12d6f236d9b4d968ffd3beeb2cf7b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:08Z,use_quota=True,user_id='50776d8b6b1a411e928225d29cb940f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:53:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Creating volume 4d015af7-de83-4994-83c7-4abe74a0cbb0 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:53:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:53:09 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:53:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4d015af7-de83-4994-83c7-4abe74a0cbb0 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:09 devstack sudo[87242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4d015af7-de83-4994-83c7-4abe74a0cbb0 1073741824 Apr 28 05:53:09 devstack sudo[87242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba61d16e-92c0-45b3-bc35-26f5fb1dec59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeb71fb6-c945-46a7-b842-0ba8bf010b3e', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d37669-0175-493b-9b2a-473558ee2b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:09 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Volume volume-aeb71fb6-c945-46a7-b842-0ba8bf010b3e (aeb71fb6-c945-46a7-b842-0ba8bf010b3e): created successfully Apr 28 05:53:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d37669-0175-493b-9b2a-473558ee2b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Flow 'volume_create_manager' (d399516a-b73d-42a7-9a47-d18b0ec6ee6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:09 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-1f6c8578-08a6-46e5-9ec8-068b3f5d8fca tempest-VolumesActionsTest-1383043696 None] Created volume successfully. Apr 28 05:53:10 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c4b361e8-94c4-481d-8148-b10f4382bdb6 tempest-VolumesActionsTest-71890540 None] Acquiring lock "cinder-aeb71fb6-c945-46a7-b842-0ba8bf010b3e-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:10 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c4b361e8-94c4-481d-8148-b10f4382bdb6 tempest-VolumesActionsTest-71890540 None] Lock "cinder-aeb71fb6-c945-46a7-b842-0ba8bf010b3e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:10 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c4b361e8-94c4-481d-8148-b10f4382bdb6 tempest-VolumesActionsTest-71890540 None] Acquiring lock "cinder-quobyte-aeb71fb6-c945-46a7-b842-0ba8bf010b3e" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:10 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c4b361e8-94c4-481d-8148-b10f4382bdb6 tempest-VolumesActionsTest-71890540 None] Lock "cinder-quobyte-aeb71fb6-c945-46a7-b842-0ba8bf010b3e" acquired by "delete_volume" :: waited 0.025s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:10 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c31e37e-8f39-431d-aa1a-fc10ab017173]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:53:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c4b361e8-94c4-481d-8148-b10f4382bdb6 tempest-VolumesActionsTest-71890540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-aeb71fb6-c945-46a7-b842-0ba8bf010b3e {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:10 devstack sudo[87247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-aeb71fb6-c945-46a7-b842-0ba8bf010b3e Apr 28 05:53:10 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:10 devstack sudo[87242]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4d015af7-de83-4994-83c7-4abe74a0cbb0 1073741824" returned: 0 in 0.727s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4d015af7-de83-4994-83c7-4abe74a0cbb0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:10 devstack sudo[87249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4d015af7-de83-4994-83c7-4abe74a0cbb0 Apr 28 05:53:10 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:10 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c4b361e8-94c4-481d-8148-b10f4382bdb6 tempest-VolumesActionsTest-71890540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-aeb71fb6-c945-46a7-b842-0ba8bf010b3e" returned: 0 in 0.602s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c4b361e8-94c4-481d-8148-b10f4382bdb6 tempest-VolumesActionsTest-71890540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-aeb71fb6-c945-46a7-b842-0ba8bf010b3e {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:11 devstack sudo[87255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-aeb71fb6-c945-46a7-b842-0ba8bf010b3e Apr 28 05:53:11 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:11 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4d015af7-de83-4994-83c7-4abe74a0cbb0" returned: 0 in 0.547s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:11 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:53:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-65834a20-aa8a-4dcd-b0e8-66eafa606ab3 tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.907s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ed2b6b-f946-4819-95cf-a86701bea83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d015af7-de83-4994-83c7-4abe74a0cbb0', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b052134-29fd-47a4-9bee-17cdfaa53ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:11 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-65834a20-aa8a-4dcd-b0e8-66eafa606ab3 tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Creating offline snapshot bb9743d7-32e1-49de-ab84-ab94d9c26017 of volume 4052ca57-336e-4bb3-b6c5-1e611aef2627 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:53:11 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Volume volume-4d015af7-de83-4994-83c7-4abe74a0cbb0 (4d015af7-de83-4994-83c7-4abe74a0cbb0): created successfully Apr 28 05:53:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b052134-29fd-47a4-9bee-17cdfaa53ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Flow 'volume_create_manager' (898ab5da-70ff-4af6-8c3f-30d6cb41af84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:11 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc60361c-bd60-4688-be4d-88abf569a361]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:53:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-65834a20-aa8a-4dcd-b0e8-66eafa606ab3 tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:11 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-7f532968-8366-4e77-8e58-0038a34c68b2 tempest-VolumesTransfersTest-921194713 None] Created volume successfully. Apr 28 05:53:11 devstack sudo[87258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627 Apr 28 05:53:11 devstack sudo[87258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:11 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c4b361e8-94c4-481d-8148-b10f4382bdb6 tempest-VolumesActionsTest-71890540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-aeb71fb6-c945-46a7-b842-0ba8bf010b3e" returned: 0 in 0.524s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:11 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c4b361e8-94c4-481d-8148-b10f4382bdb6 tempest-VolumesActionsTest-71890540 None] Lock "cinder-quobyte-aeb71fb6-c945-46a7-b842-0ba8bf010b3e" released by "delete_volume" :: held 1.169s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:11 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-c4b361e8-94c4-481d-8148-b10f4382bdb6 tempest-VolumesActionsTest-71890540 None] Created reservations ['17fba28d-a277-40f3-a432-9bb939a2d2fe', 'c64240fd-7c46-400a-a304-764865ca3a6b', 'a92bb48b-9648-467f-b80d-8e68b7ecece3', '756373ec-f7e2-45f7-81d8-a8e376ad8d8b'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:53:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c4b361e8-94c4-481d-8148-b10f4382bdb6 tempest-VolumesActionsTest-71890540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c4b361e8-94c4-481d-8148-b10f4382bdb6 tempest-VolumesActionsTest-71890540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:11 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c4b361e8-94c4-481d-8148-b10f4382bdb6 tempest-VolumesActionsTest-71890540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:11 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c4b361e8-94c4-481d-8148-b10f4382bdb6 tempest-VolumesActionsTest-71890540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c4b361e8-94c4-481d-8148-b10f4382bdb6 tempest-VolumesActionsTest-71890540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c4b361e8-94c4-481d-8148-b10f4382bdb6 tempest-VolumesActionsTest-71890540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:11 devstack sudo[87263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:53:11 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:11 devstack sudo[87258]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-65834a20-aa8a-4dcd-b0e8-66eafa606ab3 tempest-VolumesSnapshotNegativeTestJSON-150624160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627" returned: 0 in 0.576s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-65834a20-aa8a-4dcd-b0e8-66eafa606ab3 tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.bb9743d7-32e1-49de-ab84-ab94d9c26017 2G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:11 devstack sudo[87266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.bb9743d7-32e1-49de-ab84-ab94d9c26017 2G Apr 28 05:53:11 devstack sudo[87266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:12 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c4b361e8-94c4-481d-8148-b10f4382bdb6 tempest-VolumesActionsTest-71890540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.691s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:12 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-c4b361e8-94c4-481d-8148-b10f4382bdb6 tempest-VolumesActionsTest-71890540 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:53:12 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-c4b361e8-94c4-481d-8148-b10f4382bdb6 tempest-VolumesActionsTest-71890540 None] Deleted volume successfully. Apr 28 05:53:12 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c4b361e8-94c4-481d-8148-b10f4382bdb6 tempest-VolumesActionsTest-71890540 None] Lock "cinder-aeb71fb6-c945-46a7-b842-0ba8bf010b3e-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:12 devstack sudo[87266]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-65834a20-aa8a-4dcd-b0e8-66eafa606ab3 tempest-VolumesSnapshotNegativeTestJSON-150624160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.bb9743d7-32e1-49de-ab84-ab94d9c26017 2G" returned: 0 in 0.900s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-65834a20-aa8a-4dcd-b0e8-66eafa606ab3 tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4052ca57-336e-4bb3-b6c5-1e611aef2627 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.bb9743d7-32e1-49de-ab84-ab94d9c26017 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:12 devstack sudo[87272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4052ca57-336e-4bb3-b6c5-1e611aef2627 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.bb9743d7-32e1-49de-ab84-ab94d9c26017 Apr 28 05:53:12 devstack sudo[87272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:13 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-8c17144f-7deb-410d-b9b1-e1cc87d81267 tempest-VolumesTransfersTest-302200049 None] Transfer volume completed successfully. Apr 28 05:53:13 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:53:13 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Flow 'volume_create_manager' (83314674-86cb-4f73-8dfb-44cf529e02e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:13 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6549ae05-2593-4ab5-aebf-ad4e3ae637a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:13 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6549ae05-2593-4ab5-aebf-ad4e3ae637a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1824164301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d1700c-f5bb-485f-b8d0-37c050da3108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60185b1cc53480482300b7052922989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:13Z,use_quota=True,user_id='281c2c64fd424ad99f061e6d212b60c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:13 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27eef8a-77a2-4f6a-aecb-ef62de70b1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:13 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27eef8a-77a2-4f6a-aecb-ef62de70b1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:13 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1aca3f-92e3-4775-b2ba-f03dc541ed13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:13 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1aca3f-92e3-4775-b2ba-f03dc541ed13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d1700c-f5bb-485f-b8d0-37c050da3108', 'volume_name': 'volume-42d1700c-f5bb-485f-b8d0-37c050da3108', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:13 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a94518-d6db-4a36-97cc-32f0b369dc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:13 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a94518-d6db-4a36-97cc-32f0b369dc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:13 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a325f5-ee37-404a-85ed-d70f49b761d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:13 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Volume 42d1700c-f5bb-485f-b8d0-37c050da3108: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d1700c-f5bb-485f-b8d0-37c050da3108', 'volume_size': 1} Apr 28 05:53:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:13 devstack sudo[87272]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-65834a20-aa8a-4dcd-b0e8-66eafa606ab3 tempest-VolumesSnapshotNegativeTestJSON-150624160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4052ca57-336e-4bb3-b6c5-1e611aef2627 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.bb9743d7-32e1-49de-ab84-ab94d9c26017" returned: 0 in 0.697s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:13 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-65834a20-aa8a-4dcd-b0e8-66eafa606ab3 tempest-VolumesSnapshotNegativeTestJSON-150624160 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.bb9743d7-32e1-49de-ab84-ab94d9c26017 is being set with open permissions: ugo+rw Apr 28 05:53:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-65834a20-aa8a-4dcd-b0e8-66eafa606ab3 tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.bb9743d7-32e1-49de-ab84-ab94d9c26017 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:13 devstack sudo[87278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.bb9743d7-32e1-49de-ab84-ab94d9c26017 Apr 28 05:53:13 devstack sudo[87278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:13 devstack sudo[87278]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-65834a20-aa8a-4dcd-b0e8-66eafa606ab3 tempest-VolumesSnapshotNegativeTestJSON-150624160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.bb9743d7-32e1-49de-ab84-ab94d9c26017" returned: 0 in 0.527s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-65834a20-aa8a-4dcd-b0e8-66eafa606ab3 tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:13 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-fc688095-c1a6-4ab2-961d-bf24530dc30d tempest-VolumesTransfersTest-1026107095 None] Acquiring lock "cinder-4d015af7-de83-4994-83c7-4abe74a0cbb0-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:13 devstack sudo[87281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.info Apr 28 05:53:13 devstack sudo[87281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:13 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-fc688095-c1a6-4ab2-961d-bf24530dc30d tempest-VolumesTransfersTest-1026107095 None] Lock "cinder-4d015af7-de83-4994-83c7-4abe74a0cbb0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:14 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-fc688095-c1a6-4ab2-961d-bf24530dc30d tempest-VolumesTransfersTest-1026107095 None] Acquiring lock "cinder-quobyte-4d015af7-de83-4994-83c7-4abe74a0cbb0" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:14 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-fc688095-c1a6-4ab2-961d-bf24530dc30d tempest-VolumesTransfersTest-1026107095 None] Lock "cinder-quobyte-4d015af7-de83-4994-83c7-4abe74a0cbb0" acquired by "delete_volume" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:14 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c943ac-38ea-4e99-8a3b-6e871217c8fa]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:53:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-fc688095-c1a6-4ab2-961d-bf24530dc30d tempest-VolumesTransfersTest-1026107095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4d015af7-de83-4994-83c7-4abe74a0cbb0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:14 devstack sudo[87283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4d015af7-de83-4994-83c7-4abe74a0cbb0 Apr 28 05:53:14 devstack sudo[87283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:14 devstack sudo[87281]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-65834a20-aa8a-4dcd-b0e8-66eafa606ab3 tempest-VolumesSnapshotNegativeTestJSON-150624160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.info" returned: 0 in 0.644s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:14 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-65834a20-aa8a-4dcd-b0e8-66eafa606ab3 tempest-VolumesSnapshotNegativeTestJSON-150624160 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.info is being set with open permissions: ugo+rw Apr 28 05:53:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-65834a20-aa8a-4dcd-b0e8-66eafa606ab3 tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:14 devstack sudo[87286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.info Apr 28 05:53:14 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:14 devstack sudo[87283]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-fc688095-c1a6-4ab2-961d-bf24530dc30d tempest-VolumesTransfersTest-1026107095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4d015af7-de83-4994-83c7-4abe74a0cbb0" returned: 0 in 0.688s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-fc688095-c1a6-4ab2-961d-bf24530dc30d tempest-VolumesTransfersTest-1026107095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4d015af7-de83-4994-83c7-4abe74a0cbb0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:14 devstack sudo[87291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4d015af7-de83-4994-83c7-4abe74a0cbb0 Apr 28 05:53:14 devstack sudo[87291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:15 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-65834a20-aa8a-4dcd-b0e8-66eafa606ab3 tempest-VolumesSnapshotNegativeTestJSON-150624160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.info" returned: 0 in 0.562s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-65834a20-aa8a-4dcd-b0e8-66eafa606ab3 tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.020s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.992s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1824164301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d1700c-f5bb-485f-b8d0-37c050da3108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60185b1cc53480482300b7052922989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:13Z,use_quota=True,user_id='281c2c64fd424ad99f061e6d212b60c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Creating volume 42d1700c-f5bb-485f-b8d0-37c050da3108 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:53:15 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-42d1700c-f5bb-485f-b8d0-37c050da3108 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:15 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-65834a20-aa8a-4dcd-b0e8-66eafa606ab3 tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Create snapshot completed successfully Apr 28 05:53:15 devstack sudo[87294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-42d1700c-f5bb-485f-b8d0-37c050da3108 1073741824 Apr 28 05:53:15 devstack sudo[87294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:15 devstack sudo[87291]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-fc688095-c1a6-4ab2-961d-bf24530dc30d tempest-VolumesTransfersTest-1026107095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4d015af7-de83-4994-83c7-4abe74a0cbb0" returned: 0 in 0.534s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-fc688095-c1a6-4ab2-961d-bf24530dc30d tempest-VolumesTransfersTest-1026107095 None] Lock "cinder-quobyte-4d015af7-de83-4994-83c7-4abe74a0cbb0" released by "delete_volume" :: held 1.267s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-fc688095-c1a6-4ab2-961d-bf24530dc30d tempest-VolumesTransfersTest-1026107095 None] Created reservations ['bf6d3abb-7f5a-4273-b227-1618215d184d', '1364e49b-e91d-47af-849b-70770b0b3460', '3e47f551-0281-475a-bee5-e6ae018c2ff8', '7e5a1786-9fe1-4a9c-8d16-163b99d285e3'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-fc688095-c1a6-4ab2-961d-bf24530dc30d tempest-VolumesTransfersTest-1026107095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-fc688095-c1a6-4ab2-961d-bf24530dc30d tempest-VolumesTransfersTest-1026107095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-fc688095-c1a6-4ab2-961d-bf24530dc30d tempest-VolumesTransfersTest-1026107095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-fc688095-c1a6-4ab2-961d-bf24530dc30d tempest-VolumesTransfersTest-1026107095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-fc688095-c1a6-4ab2-961d-bf24530dc30d tempest-VolumesTransfersTest-1026107095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-fc688095-c1a6-4ab2-961d-bf24530dc30d tempest-VolumesTransfersTest-1026107095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:15 devstack sudo[87297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:53:15 devstack sudo[87297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1112b5e1-1997-44e0-bd49-68c30150baeb tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Acquiring lock "cinder-bb9743d7-32e1-49de-ab84-ab94d9c26017-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1112b5e1-1997-44e0-bd49-68c30150baeb tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Lock "cinder-bb9743d7-32e1-49de-ab84-ab94d9c26017-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1112b5e1-1997-44e0-bd49-68c30150baeb tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Acquiring lock "cinder-quobyte-4052ca57-336e-4bb3-b6c5-1e611aef2627" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1112b5e1-1997-44e0-bd49-68c30150baeb tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Lock "cinder-quobyte-4052ca57-336e-4bb3-b6c5-1e611aef2627" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1112b5e1-1997-44e0-bd49-68c30150baeb tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Acquiring lock "cinder-quobyte-bb9743d7-32e1-49de-ab84-ab94d9c26017" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1112b5e1-1997-44e0-bd49-68c30150baeb tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Lock "cinder-quobyte-bb9743d7-32e1-49de-ab84-ab94d9c26017" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-1112b5e1-1997-44e0-bd49-68c30150baeb tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Deleting offline snapshot bb9743d7-32e1-49de-ab84-ab94d9c26017 of volume 4052ca57-336e-4bb3-b6c5-1e611aef2627 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-1112b5e1-1997-44e0-bd49-68c30150baeb tempest-VolumesSnapshotNegativeTestJSON-150624160 None] snapshot_file for this snap is: volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.bb9743d7-32e1-49de-ab84-ab94d9c26017 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b869cd-3040-4c5a-b68a-40699b9b7cce]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1112b5e1-1997-44e0-bd49-68c30150baeb tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.bb9743d7-32e1-49de-ab84-ab94d9c26017 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:15 devstack sudo[87302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.bb9743d7-32e1-49de-ab84-ab94d9c26017 Apr 28 05:53:15 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:15 devstack sudo[87294]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-42d1700c-f5bb-485f-b8d0-37c050da3108 1073741824" returned: 0 in 0.791s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-42d1700c-f5bb-485f-b8d0-37c050da3108 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:16 devstack sudo[87297]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:16 devstack sudo[87305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-42d1700c-f5bb-485f-b8d0-37c050da3108 Apr 28 05:53:16 devstack sudo[87305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-fc688095-c1a6-4ab2-961d-bf24530dc30d tempest-VolumesTransfersTest-1026107095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.551s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-fc688095-c1a6-4ab2-961d-bf24530dc30d tempest-VolumesTransfersTest-1026107095 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:53:16 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-fc688095-c1a6-4ab2-961d-bf24530dc30d tempest-VolumesTransfersTest-1026107095 None] Deleted volume successfully. Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-fc688095-c1a6-4ab2-961d-bf24530dc30d tempest-VolumesTransfersTest-1026107095 None] Lock "cinder-4d015af7-de83-4994-83c7-4abe74a0cbb0-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:16 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1112b5e1-1997-44e0-bd49-68c30150baeb tempest-VolumesSnapshotNegativeTestJSON-150624160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.bb9743d7-32e1-49de-ab84-ab94d9c26017" returned: 0 in 0.860s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-1112b5e1-1997-44e0-bd49-68c30150baeb tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4052ca57-336e-4bb3-b6c5-1e611aef2627(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6f3b57-5633-4a8e-b282-7385d834629a]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1112b5e1-1997-44e0-bd49-68c30150baeb tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:16 devstack sudo[87305]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-42d1700c-f5bb-485f-b8d0-37c050da3108" returned: 0 in 0.699s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:16 devstack sudo[87311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627 Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a325f5-ee37-404a-85ed-d70f49b761d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d1700c-f5bb-485f-b8d0-37c050da3108', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:16 devstack sudo[87311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beab88ed-a4f8-4106-a961-0f6fe818e954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Flow 'volume_create_manager' (ad1876ea-cae3-47dc-a8bb-47d5811592a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75fcf879-71fb-4de4-b06e-2329be90358c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:16 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Volume volume-42d1700c-f5bb-485f-b8d0-37c050da3108 (42d1700c-f5bb-485f-b8d0-37c050da3108): created successfully Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beab88ed-a4f8-4106-a961-0f6fe818e954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Flow 'volume_create_manager' (83314674-86cb-4f73-8dfb-44cf529e02e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75fcf879-71fb-4de4-b06e-2329be90358c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1032790190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ecded27-4803-403a-b7fc-3966ca8a71fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12d6f236d9b4d968ffd3beeb2cf7b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:17Z,use_quota=True,user_id='50776d8b6b1a411e928225d29cb940f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055d0f3e-d06b-45db-98f2-67c01a28349f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055d0f3e-d06b-45db-98f2-67c01a28349f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba3e8dad-5091-4a5d-a429-863bb7a55f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba3e8dad-5091-4a5d-a429-863bb7a55f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ecded27-4803-403a-b7fc-3966ca8a71fd', 'volume_name': 'volume-3ecded27-4803-403a-b7fc-3966ca8a71fd', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4897409c-328e-4b03-98b4-bd8c83638473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4897409c-328e-4b03-98b4-bd8c83638473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348e3fd2-a3f1-4c78-a76a-6f616a240e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:16 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Volume 3ecded27-4803-403a-b7fc-3966ca8a71fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ecded27-4803-403a-b7fc-3966ca8a71fd', 'volume_size': 1} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1032790190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ecded27-4803-403a-b7fc-3966ca8a71fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12d6f236d9b4d968ffd3beeb2cf7b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:17Z,use_quota=True,user_id='50776d8b6b1a411e928225d29cb940f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Creating volume 3ecded27-4803-403a-b7fc-3966ca8a71fd {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:53:16 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:53:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3ecded27-4803-403a-b7fc-3966ca8a71fd 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:16 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-d23797b1-c3b4-4210-a7fd-17c5eb21b1bf tempest-VolumesActionsTest-1383043696 None] Created volume successfully. Apr 28 05:53:16 devstack sudo[87313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3ecded27-4803-403a-b7fc-3966ca8a71fd 1073741824 Apr 28 05:53:16 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:17 devstack sudo[87311]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1112b5e1-1997-44e0-bd49-68c30150baeb tempest-VolumesSnapshotNegativeTestJSON-150624160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627" returned: 0 in 0.764s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1112b5e1-1997-44e0-bd49-68c30150baeb tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.bb9743d7-32e1-49de-ab84-ab94d9c26017 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:17 devstack sudo[87319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.bb9743d7-32e1-49de-ab84-ab94d9c26017 Apr 28 05:53:17 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:17 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-794cbfa4-bfa1-48cc-b35b-3e3a2623438c tempest-VolumesActionsTest-71890540 None] Acquiring lock "cinder-42d1700c-f5bb-485f-b8d0-37c050da3108-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:17 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-794cbfa4-bfa1-48cc-b35b-3e3a2623438c tempest-VolumesActionsTest-71890540 None] Lock "cinder-42d1700c-f5bb-485f-b8d0-37c050da3108-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:17 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-794cbfa4-bfa1-48cc-b35b-3e3a2623438c tempest-VolumesActionsTest-71890540 None] Acquiring lock "cinder-quobyte-42d1700c-f5bb-485f-b8d0-37c050da3108" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:17 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-794cbfa4-bfa1-48cc-b35b-3e3a2623438c tempest-VolumesActionsTest-71890540 None] Lock "cinder-quobyte-42d1700c-f5bb-485f-b8d0-37c050da3108" acquired by "delete_volume" :: waited 0.036s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:17 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[4370ce12-2662-440a-8805-0af5c3a5c3d8]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:53:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-794cbfa4-bfa1-48cc-b35b-3e3a2623438c tempest-VolumesActionsTest-71890540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-42d1700c-f5bb-485f-b8d0-37c050da3108 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:17 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3ecded27-4803-403a-b7fc-3966ca8a71fd 1073741824" returned: 0 in 0.963s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3ecded27-4803-403a-b7fc-3966ca8a71fd {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:17 devstack sudo[87325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3ecded27-4803-403a-b7fc-3966ca8a71fd Apr 28 05:53:17 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:17 devstack sudo[87324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-42d1700c-f5bb-485f-b8d0-37c050da3108 Apr 28 05:53:17 devstack sudo[87324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:18 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1112b5e1-1997-44e0-bd49-68c30150baeb tempest-VolumesSnapshotNegativeTestJSON-150624160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.bb9743d7-32e1-49de-ab84-ab94d9c26017" returned: 0 in 0.819s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1112b5e1-1997-44e0-bd49-68c30150baeb tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.bb9743d7-32e1-49de-ab84-ab94d9c26017 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:18 devstack sudo[87331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.bb9743d7-32e1-49de-ab84-ab94d9c26017 Apr 28 05:53:18 devstack sudo[87331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:18 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3ecded27-4803-403a-b7fc-3966ca8a71fd" returned: 0 in 0.556s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:53:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348e3fd2-a3f1-4c78-a76a-6f616a240e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ecded27-4803-403a-b7fc-3966ca8a71fd', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f46cde-89a7-4a32-b22a-72511737ed1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:18 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Volume volume-3ecded27-4803-403a-b7fc-3966ca8a71fd (3ecded27-4803-403a-b7fc-3966ca8a71fd): created successfully Apr 28 05:53:18 devstack sudo[87324]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f46cde-89a7-4a32-b22a-72511737ed1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Flow 'volume_create_manager' (ad1876ea-cae3-47dc-a8bb-47d5811592a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-794cbfa4-bfa1-48cc-b35b-3e3a2623438c tempest-VolumesActionsTest-71890540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-42d1700c-f5bb-485f-b8d0-37c050da3108" returned: 0 in 0.674s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-794cbfa4-bfa1-48cc-b35b-3e3a2623438c tempest-VolumesActionsTest-71890540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-42d1700c-f5bb-485f-b8d0-37c050da3108 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:18 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-14541a63-66b4-4ffc-ac8c-5356509f0fa3 tempest-VolumesTransfersTest-921194713 None] Created volume successfully. Apr 28 05:53:18 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-42d1700c-f5bb-485f-b8d0-37c050da3108 Apr 28 05:53:18 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:18 devstack sudo[87331]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1112b5e1-1997-44e0-bd49-68c30150baeb tempest-VolumesSnapshotNegativeTestJSON-150624160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627.bb9743d7-32e1-49de-ab84-ab94d9c26017" returned: 0 in 0.538s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:18 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1112b5e1-1997-44e0-bd49-68c30150baeb tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Lock "cinder-quobyte-bb9743d7-32e1-49de-ab84-ab94d9c26017" released by "_delete_snapshot" :: held 3.105s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:18 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1112b5e1-1997-44e0-bd49-68c30150baeb tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Lock "cinder-quobyte-4052ca57-336e-4bb3-b6c5-1e611aef2627" released by "delete_snapshot" :: held 3.136s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:18 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-1112b5e1-1997-44e0-bd49-68c30150baeb tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Created reservations ['abedca95-688e-4ea4-a041-83eac892eba2', 'd0451f13-0256-4024-85c1-de26c269b97e', '55c434c1-18ac-4de6-b836-b2abb625d57f', '9aa73f39-2c79-481d-bfb6-deb3491bd699'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:53:18 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-1112b5e1-1997-44e0-bd49-68c30150baeb tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Delete snapshot completed successfully. Apr 28 05:53:18 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1112b5e1-1997-44e0-bd49-68c30150baeb tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Lock "cinder-bb9743d7-32e1-49de-ab84-ab94d9c26017-delete_snapshot" released by "delete_snapshot" :: held 3.319s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:19 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-794cbfa4-bfa1-48cc-b35b-3e3a2623438c tempest-VolumesActionsTest-71890540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-42d1700c-f5bb-485f-b8d0-37c050da3108" returned: 0 in 0.536s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-794cbfa4-bfa1-48cc-b35b-3e3a2623438c tempest-VolumesActionsTest-71890540 None] Lock "cinder-quobyte-42d1700c-f5bb-485f-b8d0-37c050da3108" released by "delete_volume" :: held 1.265s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:19 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-794cbfa4-bfa1-48cc-b35b-3e3a2623438c tempest-VolumesActionsTest-71890540 None] Created reservations ['cff89b60-5273-4c76-b216-75f3a6b3162a', 'bbffce7d-9ce3-4b55-8a67-f2b482919e72', '3e2689d1-56b2-4327-83dd-b596e32ecc5f', 'c7932b2d-8eae-4cf5-b416-21205089c0d6'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:53:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-794cbfa4-bfa1-48cc-b35b-3e3a2623438c tempest-VolumesActionsTest-71890540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-794cbfa4-bfa1-48cc-b35b-3e3a2623438c tempest-VolumesActionsTest-71890540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:19 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-794cbfa4-bfa1-48cc-b35b-3e3a2623438c tempest-VolumesActionsTest-71890540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:19 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-794cbfa4-bfa1-48cc-b35b-3e3a2623438c tempest-VolumesActionsTest-71890540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-794cbfa4-bfa1-48cc-b35b-3e3a2623438c tempest-VolumesActionsTest-71890540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-794cbfa4-bfa1-48cc-b35b-3e3a2623438c tempest-VolumesActionsTest-71890540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:19 devstack sudo[87341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:53:19 devstack sudo[87341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-099e8389-cf4f-45f8-bf18-0a31df096f23 tempest-VolumesTransfersTest-1026107095 None] Acquiring lock "cinder-3ecded27-4803-403a-b7fc-3966ca8a71fd-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-099e8389-cf4f-45f8-bf18-0a31df096f23 tempest-VolumesTransfersTest-1026107095 None] Lock "cinder-3ecded27-4803-403a-b7fc-3966ca8a71fd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-099e8389-cf4f-45f8-bf18-0a31df096f23 tempest-VolumesTransfersTest-1026107095 None] Acquiring lock "cinder-quobyte-3ecded27-4803-403a-b7fc-3966ca8a71fd" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-099e8389-cf4f-45f8-bf18-0a31df096f23 tempest-VolumesTransfersTest-1026107095 None] Lock "cinder-quobyte-3ecded27-4803-403a-b7fc-3966ca8a71fd" acquired by "delete_volume" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:19 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cfc188-96ee-4242-87db-f94fcb09c9c3]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:53:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-099e8389-cf4f-45f8-bf18-0a31df096f23 tempest-VolumesTransfersTest-1026107095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3ecded27-4803-403a-b7fc-3966ca8a71fd {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:19 devstack sudo[87346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3ecded27-4803-403a-b7fc-3966ca8a71fd Apr 28 05:53:19 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:19 devstack sudo[87341]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-794cbfa4-bfa1-48cc-b35b-3e3a2623438c tempest-VolumesActionsTest-71890540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.598s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:19 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-794cbfa4-bfa1-48cc-b35b-3e3a2623438c tempest-VolumesActionsTest-71890540 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:53:19 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-794cbfa4-bfa1-48cc-b35b-3e3a2623438c tempest-VolumesActionsTest-71890540 None] Deleted volume successfully. Apr 28 05:53:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-794cbfa4-bfa1-48cc-b35b-3e3a2623438c tempest-VolumesActionsTest-71890540 None] Lock "cinder-42d1700c-f5bb-485f-b8d0-37c050da3108-delete_volume" released by "delete_volume" :: held 2.181s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-289e9e5b-d0bd-4af5-a690-7abfd419e24d tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Acquiring lock "cinder-4052ca57-336e-4bb3-b6c5-1e611aef2627-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-289e9e5b-d0bd-4af5-a690-7abfd419e24d tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Lock "cinder-4052ca57-336e-4bb3-b6c5-1e611aef2627-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-289e9e5b-d0bd-4af5-a690-7abfd419e24d tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Acquiring lock "cinder-quobyte-4052ca57-336e-4bb3-b6c5-1e611aef2627" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-289e9e5b-d0bd-4af5-a690-7abfd419e24d tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Lock "cinder-quobyte-4052ca57-336e-4bb3-b6c5-1e611aef2627" acquired by "delete_volume" :: waited 0.035s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[683a0ad1-5293-41bb-8a17-ba1ee231a390]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-289e9e5b-d0bd-4af5-a690-7abfd419e24d tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:20 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-099e8389-cf4f-45f8-bf18-0a31df096f23 tempest-VolumesTransfersTest-1026107095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3ecded27-4803-403a-b7fc-3966ca8a71fd" returned: 0 in 0.832s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-099e8389-cf4f-45f8-bf18-0a31df096f23 tempest-VolumesTransfersTest-1026107095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3ecded27-4803-403a-b7fc-3966ca8a71fd {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:20 devstack sudo[87386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3ecded27-4803-403a-b7fc-3966ca8a71fd Apr 28 05:53:20 devstack sudo[87386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:20 devstack sudo[87385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627 Apr 28 05:53:20 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Flow 'volume_create_manager' (2d572350-22fb-466e-836b-e5f79e3987b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0446b1-7a26-428b-891f-027122576d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0446b1-7a26-428b-891f-027122576d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1706091590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8a74cdf-83c1-46d7-9cac-90fd7e1265bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60185b1cc53480482300b7052922989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:21Z,use_quota=True,user_id='281c2c64fd424ad99f061e6d212b60c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be33c76b-0f51-4b2c-b85f-c4cf1db29aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be33c76b-0f51-4b2c-b85f-c4cf1db29aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55043bd9-3276-40d0-89cc-083bb8559e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55043bd9-3276-40d0-89cc-083bb8559e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8a74cdf-83c1-46d7-9cac-90fd7e1265bd', 'volume_name': 'volume-b8a74cdf-83c1-46d7-9cac-90fd7e1265bd', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211ca1da-0e33-48cd-9a62-b79bcf620907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211ca1da-0e33-48cd-9a62-b79bcf620907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7438ac-2d78-495c-80d3-a44f7055f68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:20 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Volume b8a74cdf-83c1-46d7-9cac-90fd7e1265bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8a74cdf-83c1-46d7-9cac-90fd7e1265bd', 'volume_size': 1} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1706091590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8a74cdf-83c1-46d7-9cac-90fd7e1265bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60185b1cc53480482300b7052922989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:21Z,use_quota=True,user_id='281c2c64fd424ad99f061e6d212b60c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Creating volume b8a74cdf-83c1-46d7-9cac-90fd7e1265bd {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:53:20 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b8a74cdf-83c1-46d7-9cac-90fd7e1265bd 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:20 devstack sudo[87399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b8a74cdf-83c1-46d7-9cac-90fd7e1265bd 1073741824 Apr 28 05:53:20 devstack sudo[87399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:20 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-289e9e5b-d0bd-4af5-a690-7abfd419e24d tempest-VolumesSnapshotNegativeTestJSON-150624160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627" returned: 0 in 0.729s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-289e9e5b-d0bd-4af5-a690-7abfd419e24d tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:20 devstack sudo[87386]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-099e8389-cf4f-45f8-bf18-0a31df096f23 tempest-VolumesTransfersTest-1026107095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3ecded27-4803-403a-b7fc-3966ca8a71fd" returned: 0 in 0.704s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:20 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627 Apr 28 05:53:20 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-099e8389-cf4f-45f8-bf18-0a31df096f23 tempest-VolumesTransfersTest-1026107095 None] Lock "cinder-quobyte-3ecded27-4803-403a-b7fc-3966ca8a71fd" released by "delete_volume" :: held 1.598s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:21 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-099e8389-cf4f-45f8-bf18-0a31df096f23 tempest-VolumesTransfersTest-1026107095 None] Created reservations ['14862296-d15f-4f11-ad54-09a7bb52e87a', '64b30a79-c454-43c7-b0a4-d528b3f9ddef', 'd37085dc-bebf-439c-9c06-04848918ffc4', '959968ee-8fc0-4ff0-b3fc-00154923b169'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:53:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-099e8389-cf4f-45f8-bf18-0a31df096f23 tempest-VolumesTransfersTest-1026107095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-099e8389-cf4f-45f8-bf18-0a31df096f23 tempest-VolumesTransfersTest-1026107095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-099e8389-cf4f-45f8-bf18-0a31df096f23 tempest-VolumesTransfersTest-1026107095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-099e8389-cf4f-45f8-bf18-0a31df096f23 tempest-VolumesTransfersTest-1026107095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-099e8389-cf4f-45f8-bf18-0a31df096f23 tempest-VolumesTransfersTest-1026107095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-099e8389-cf4f-45f8-bf18-0a31df096f23 tempest-VolumesTransfersTest-1026107095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:21 devstack sudo[87404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:53:21 devstack sudo[87404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:21 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-289e9e5b-d0bd-4af5-a690-7abfd419e24d tempest-VolumesSnapshotNegativeTestJSON-150624160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4052ca57-336e-4bb3-b6c5-1e611aef2627" returned: 0 in 0.552s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-289e9e5b-d0bd-4af5-a690-7abfd419e24d tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Lock "cinder-quobyte-4052ca57-336e-4bb3-b6c5-1e611aef2627" released by "delete_volume" :: held 1.373s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:21 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-289e9e5b-d0bd-4af5-a690-7abfd419e24d tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Created reservations ['0452af66-fa55-4959-8edd-68e4204a3edb', '78cb190e-fae7-4810-b6e1-ffabda6a27b9', '61e2afa8-95a2-4487-9842-282ff36c5d8c', '20e6e5cf-19b8-4251-b5dc-a4c5a81b8dce'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:53:21 devstack sudo[87399]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b8a74cdf-83c1-46d7-9cac-90fd7e1265bd 1073741824" returned: 0 in 0.827s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-289e9e5b-d0bd-4af5-a690-7abfd419e24d tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-289e9e5b-d0bd-4af5-a690-7abfd419e24d tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-289e9e5b-d0bd-4af5-a690-7abfd419e24d tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-289e9e5b-d0bd-4af5-a690-7abfd419e24d tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-289e9e5b-d0bd-4af5-a690-7abfd419e24d tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-289e9e5b-d0bd-4af5-a690-7abfd419e24d tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b8a74cdf-83c1-46d7-9cac-90fd7e1265bd {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:21 devstack sudo[87411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:53:21 devstack sudo[87411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:21 devstack sudo[87412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b8a74cdf-83c1-46d7-9cac-90fd7e1265bd Apr 28 05:53:21 devstack sudo[87412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:21 devstack sudo[87404]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-099e8389-cf4f-45f8-bf18-0a31df096f23 tempest-VolumesTransfersTest-1026107095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.688s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:21 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-099e8389-cf4f-45f8-bf18-0a31df096f23 tempest-VolumesTransfersTest-1026107095 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:53:21 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-099e8389-cf4f-45f8-bf18-0a31df096f23 tempest-VolumesTransfersTest-1026107095 None] Deleted volume successfully. Apr 28 05:53:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-099e8389-cf4f-45f8-bf18-0a31df096f23 tempest-VolumesTransfersTest-1026107095 None] Lock "cinder-3ecded27-4803-403a-b7fc-3966ca8a71fd-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:22 devstack sudo[87412]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b8a74cdf-83c1-46d7-9cac-90fd7e1265bd" returned: 0 in 0.529s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:53:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:22 devstack sudo[87411]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-289e9e5b-d0bd-4af5-a690-7abfd419e24d tempest-VolumesSnapshotNegativeTestJSON-150624160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.576s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:22 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-289e9e5b-d0bd-4af5-a690-7abfd419e24d tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:53:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7438ac-2d78-495c-80d3-a44f7055f68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8a74cdf-83c1-46d7-9cac-90fd7e1265bd', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e355711e-4eb4-440d-9dba-5b100e1a9a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:22 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-289e9e5b-d0bd-4af5-a690-7abfd419e24d tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Deleted volume successfully. Apr 28 05:53:22 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Volume volume-b8a74cdf-83c1-46d7-9cac-90fd7e1265bd (b8a74cdf-83c1-46d7-9cac-90fd7e1265bd): created successfully Apr 28 05:53:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e355711e-4eb4-440d-9dba-5b100e1a9a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Flow 'volume_create_manager' (2d572350-22fb-466e-836b-e5f79e3987b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:22 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-289e9e5b-d0bd-4af5-a690-7abfd419e24d tempest-VolumesSnapshotNegativeTestJSON-150624160 None] Lock "cinder-4052ca57-336e-4bb3-b6c5-1e611aef2627-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:22 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-841dfd9e-a8de-40a2-b51d-dfae058683a6 tempest-VolumesActionsTest-1383043696 None] Created volume successfully. Apr 28 05:53:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-84d1ee4c-f5f6-430c-95e7-4ad4cc931d2e tempest-VolumesActionsTest-1383043696 None] Acquiring lock "cinder-b8a74cdf-83c1-46d7-9cac-90fd7e1265bd-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-84d1ee4c-f5f6-430c-95e7-4ad4cc931d2e tempest-VolumesActionsTest-1383043696 None] Lock "cinder-b8a74cdf-83c1-46d7-9cac-90fd7e1265bd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-84d1ee4c-f5f6-430c-95e7-4ad4cc931d2e tempest-VolumesActionsTest-1383043696 None] Acquiring lock "cinder-quobyte-b8a74cdf-83c1-46d7-9cac-90fd7e1265bd" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-84d1ee4c-f5f6-430c-95e7-4ad4cc931d2e tempest-VolumesActionsTest-1383043696 None] Lock "cinder-quobyte-b8a74cdf-83c1-46d7-9cac-90fd7e1265bd" acquired by "delete_volume" :: waited 0.019s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:23 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a592a4-368c-40ee-9a98-73815304d37a]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:53:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-84d1ee4c-f5f6-430c-95e7-4ad4cc931d2e tempest-VolumesActionsTest-1383043696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b8a74cdf-83c1-46d7-9cac-90fd7e1265bd {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:24 devstack sudo[87417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b8a74cdf-83c1-46d7-9cac-90fd7e1265bd Apr 28 05:53:24 devstack sudo[87417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:24 devstack sudo[87417]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-84d1ee4c-f5f6-430c-95e7-4ad4cc931d2e tempest-VolumesActionsTest-1383043696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b8a74cdf-83c1-46d7-9cac-90fd7e1265bd" returned: 0 in 0.725s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-84d1ee4c-f5f6-430c-95e7-4ad4cc931d2e tempest-VolumesActionsTest-1383043696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b8a74cdf-83c1-46d7-9cac-90fd7e1265bd {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:24 devstack sudo[87422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b8a74cdf-83c1-46d7-9cac-90fd7e1265bd Apr 28 05:53:24 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:25 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-84d1ee4c-f5f6-430c-95e7-4ad4cc931d2e tempest-VolumesActionsTest-1383043696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b8a74cdf-83c1-46d7-9cac-90fd7e1265bd" returned: 0 in 0.702s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-84d1ee4c-f5f6-430c-95e7-4ad4cc931d2e tempest-VolumesActionsTest-1383043696 None] Lock "cinder-quobyte-b8a74cdf-83c1-46d7-9cac-90fd7e1265bd" released by "delete_volume" :: held 1.506s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:25 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-84d1ee4c-f5f6-430c-95e7-4ad4cc931d2e tempest-VolumesActionsTest-1383043696 None] Created reservations ['e1c5e2dc-a12a-47a0-ac51-bfa63002fea5', 'cec76305-956b-4d47-a7b3-c2cfa6f55bc7', '7606e795-762e-46df-a8a6-a39459c8f84a', '5791e633-e11c-462e-b97b-c7260b071fcf'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:53:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-84d1ee4c-f5f6-430c-95e7-4ad4cc931d2e tempest-VolumesActionsTest-1383043696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-84d1ee4c-f5f6-430c-95e7-4ad4cc931d2e tempest-VolumesActionsTest-1383043696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-84d1ee4c-f5f6-430c-95e7-4ad4cc931d2e tempest-VolumesActionsTest-1383043696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-84d1ee4c-f5f6-430c-95e7-4ad4cc931d2e tempest-VolumesActionsTest-1383043696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-84d1ee4c-f5f6-430c-95e7-4ad4cc931d2e tempest-VolumesActionsTest-1383043696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-84d1ee4c-f5f6-430c-95e7-4ad4cc931d2e tempest-VolumesActionsTest-1383043696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:25 devstack sudo[87425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:53:25 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Flow 'volume_create_manager' (c2fa9672-38a5-4d4b-8067-b2848bd87195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62ef1c3-e102-458e-848b-16c679a17a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62ef1c3-e102-458e-848b-16c679a17a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1111752106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aba03c5-f6da-44e1-a923-6c91ccf9e179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9126f826ab6441a89b1f11ebb7bae324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:26Z,use_quota=True,user_id='2716b5022cab43b69801b55b553db876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca6409bc-54dc-4cab-82ad-bb0fa42dd7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca6409bc-54dc-4cab-82ad-bb0fa42dd7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efff63bb-4504-4909-813e-d73adde63488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efff63bb-4504-4909-813e-d73adde63488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aba03c5-f6da-44e1-a923-6c91ccf9e179', 'volume_name': 'volume-8aba03c5-f6da-44e1-a923-6c91ccf9e179', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275362cf-227f-4dfc-96e0-0d6fe8036537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275362cf-227f-4dfc-96e0-0d6fe8036537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ec484c-7031-44d2-8bba-c5fbff8f1c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:26 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Volume 8aba03c5-f6da-44e1-a923-6c91ccf9e179: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aba03c5-f6da-44e1-a923-6c91ccf9e179', 'volume_size': 1} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1111752106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aba03c5-f6da-44e1-a923-6c91ccf9e179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9126f826ab6441a89b1f11ebb7bae324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:26Z,use_quota=True,user_id='2716b5022cab43b69801b55b553db876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Creating volume 8aba03c5-f6da-44e1-a923-6c91ccf9e179 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:53:26 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8aba03c5-f6da-44e1-a923-6c91ccf9e179 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:26 devstack sudo[87431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8aba03c5-f6da-44e1-a923-6c91ccf9e179 1073741824 Apr 28 05:53:26 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Flow 'volume_create_manager' (e966260c-d46c-424a-9b06-9b8695a5a311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a152e21-c654-4f74-a28c-843e9a217805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a152e21-c654-4f74-a28c-843e9a217805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-455918943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108b194d-f032-4aab-871c-f49fa4c0f02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9126f826ab6441a89b1f11ebb7bae324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:27Z,use_quota=True,user_id='2716b5022cab43b69801b55b553db876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe62229-60e5-4257-aaa2-71ac9a955cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe62229-60e5-4257-aaa2-71ac9a955cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef518e2-067b-4c48-bcb4-036a506ea3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef518e2-067b-4c48-bcb4-036a506ea3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '108b194d-f032-4aab-871c-f49fa4c0f02c', 'volume_name': 'volume-108b194d-f032-4aab-871c-f49fa4c0f02c', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c4bf9f-6827-4ffc-9c1d-7682ac5f5262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c4bf9f-6827-4ffc-9c1d-7682ac5f5262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d37b6d-39fd-4d06-bf3b-62de225e700e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:26 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Volume 108b194d-f032-4aab-871c-f49fa4c0f02c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-108b194d-f032-4aab-871c-f49fa4c0f02c', 'volume_size': 1} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:26 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-84d1ee4c-f5f6-430c-95e7-4ad4cc931d2e tempest-VolumesActionsTest-1383043696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 1.233s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-84d1ee4c-f5f6-430c-95e7-4ad4cc931d2e tempest-VolumesActionsTest-1383043696 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:53:26 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-84d1ee4c-f5f6-430c-95e7-4ad4cc931d2e tempest-VolumesActionsTest-1383043696 None] Deleted volume successfully. Apr 28 05:53:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-84d1ee4c-f5f6-430c-95e7-4ad4cc931d2e tempest-VolumesActionsTest-1383043696 None] Lock "cinder-b8a74cdf-83c1-46d7-9cac-90fd7e1265bd-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Flow 'volume_create_manager' (0bebd112-9739-4f18-8fa4-583cbe429a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c775f69-ffb7-47d5-b19d-fb97c39cb4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c775f69-ffb7-47d5-b19d-fb97c39cb4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-931457581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd011656-1be3-44f8-9ff0-b306012466e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9126f826ab6441a89b1f11ebb7bae324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:27Z,use_quota=True,user_id='2716b5022cab43b69801b55b553db876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0881ca09-332d-4c07-bec7-5801cdad4dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0881ca09-332d-4c07-bec7-5801cdad4dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6cf1f49-78d9-444e-875c-cdcc67ccfcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6cf1f49-78d9-444e-875c-cdcc67ccfcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd011656-1be3-44f8-9ff0-b306012466e3', 'volume_name': 'volume-dd011656-1be3-44f8-9ff0-b306012466e3', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13df276-fd45-4ed7-a09e-f0f18cb88a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13df276-fd45-4ed7-a09e-f0f18cb88a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8c41b0-48af-4267-b382-884d17a1ec38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:27 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Volume dd011656-1be3-44f8-9ff0-b306012466e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd011656-1be3-44f8-9ff0-b306012466e3', 'volume_size': 1} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Flow 'volume_create_manager' (3272491d-db80-4ef2-8781-eb18bb7da832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97877838-fc9a-4c60-bd94-12e389d86e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97877838-fc9a-4c60-bd94-12e389d86e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1577606776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad55e542-64b3-4a0d-88d3-985212b482ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9126f826ab6441a89b1f11ebb7bae324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:27Z,use_quota=True,user_id='2716b5022cab43b69801b55b553db876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41091153-0b08-4833-ae77-b447d4e71066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41091153-0b08-4833-ae77-b447d4e71066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68261b1-eda6-4a66-9ecb-09f8c85c98a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68261b1-eda6-4a66-9ecb-09f8c85c98a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad55e542-64b3-4a0d-88d3-985212b482ac', 'volume_name': 'volume-ad55e542-64b3-4a0d-88d3-985212b482ac', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab10818c-49b1-422d-96de-a9e62f7d7505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab10818c-49b1-422d-96de-a9e62f7d7505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fcf0ad2-848f-47c1-8b45-202e00239a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:27 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Volume ad55e542-64b3-4a0d-88d3-985212b482ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad55e542-64b3-4a0d-88d3-985212b482ac', 'volume_size': 1} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:27 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8aba03c5-f6da-44e1-a923-6c91ccf9e179 1073741824" returned: 0 in 1.362s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8aba03c5-f6da-44e1-a923-6c91ccf9e179 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:27 devstack sudo[87450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8aba03c5-f6da-44e1-a923-6c91ccf9e179 Apr 28 05:53:27 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Flow 'volume_create_manager' (ba10a751-140b-4196-ba3e-abe258243de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0117bbc5-aa92-4510-a9f8-c19f8053c12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0117bbc5-aa92-4510-a9f8-c19f8053c12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1194487378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db5cb75-9974-4e5c-918a-a52743d143c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9126f826ab6441a89b1f11ebb7bae324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:28Z,use_quota=True,user_id='2716b5022cab43b69801b55b553db876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3616c2c9-076a-4cc8-82ee-90ec013cd714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3616c2c9-076a-4cc8-82ee-90ec013cd714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28d059d-31c9-47e0-9b7f-a3b472ea6649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28d059d-31c9-47e0-9b7f-a3b472ea6649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7db5cb75-9974-4e5c-918a-a52743d143c1', 'volume_name': 'volume-7db5cb75-9974-4e5c-918a-a52743d143c1', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c981814-0a75-492d-b8be-c3f3d379a676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c981814-0a75-492d-b8be-c3f3d379a676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9beca87a-5e33-4112-ab01-392b87f2ea31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:28 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Volume 7db5cb75-9974-4e5c-918a-a52743d143c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7db5cb75-9974-4e5c-918a-a52743d143c1', 'volume_size': 1} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:28 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8aba03c5-f6da-44e1-a923-6c91ccf9e179" returned: 0 in 0.872s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] <== create_volume: return (2281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.309s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.899s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-455918943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108b194d-f032-4aab-871c-f49fa4c0f02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9126f826ab6441a89b1f11ebb7bae324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:27Z,use_quota=True,user_id='2716b5022cab43b69801b55b553db876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Creating volume 108b194d-f032-4aab-871c-f49fa4c0f02c {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:53:28 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-108b194d-f032-4aab-871c-f49fa4c0f02c 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ec484c-7031-44d2-8bba-c5fbff8f1c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aba03c5-f6da-44e1-a923-6c91ccf9e179', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5c517a-4785-4445-b40f-ac92b07c98db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:28 devstack sudo[87460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-108b194d-f032-4aab-871c-f49fa4c0f02c 1073741824 Apr 28 05:53:28 devstack sudo[87460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:28 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Volume volume-8aba03c5-f6da-44e1-a923-6c91ccf9e179 (8aba03c5-f6da-44e1-a923-6c91ccf9e179): created successfully Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5c517a-4785-4445-b40f-ac92b07c98db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Flow 'volume_create_manager' (c2fa9672-38a5-4d4b-8067-b2848bd87195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:28 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-6a15e2d9-e65d-496f-9c19-01a757754d93 tempest-CreateVolumesFromImageTest-625448940 None] Created volume successfully. Apr 28 05:53:29 devstack sudo[87460]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-108b194d-f032-4aab-871c-f49fa4c0f02c 1073741824" returned: 0 in 0.912s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-108b194d-f032-4aab-871c-f49fa4c0f02c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:29 devstack sudo[87474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-108b194d-f032-4aab-871c-f49fa4c0f02c Apr 28 05:53:29 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:30 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-108b194d-f032-4aab-871c-f49fa4c0f02c" returned: 0 in 0.626s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.011s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-931457581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd011656-1be3-44f8-9ff0-b306012466e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9126f826ab6441a89b1f11ebb7bae324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:27Z,use_quota=True,user_id='2716b5022cab43b69801b55b553db876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Creating volume dd011656-1be3-44f8-9ff0-b306012466e3 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:53:30 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dd011656-1be3-44f8-9ff0-b306012466e3 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d37b6d-39fd-4d06-bf3b-62de225e700e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-108b194d-f032-4aab-871c-f49fa4c0f02c', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:30 devstack sudo[87477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dd011656-1be3-44f8-9ff0-b306012466e3 1073741824 Apr 28 05:53:30 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a812e747-1d5a-48a0-a95e-abf0b719581a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:30 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Volume volume-108b194d-f032-4aab-871c-f49fa4c0f02c (108b194d-f032-4aab-871c-f49fa4c0f02c): created successfully Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a812e747-1d5a-48a0-a95e-abf0b719581a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Flow 'volume_create_manager' (e966260c-d46c-424a-9b06-9b8695a5a311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:30 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-456baacc-2192-4f10-a7c5-6ae67c1a14dc tempest-CreateVolumesFromImageTest-625448940 None] Created volume successfully. Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Flow 'volume_create_manager' (ad4a46e7-9f51-41bb-928f-9688b2eee1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dc4af08-4b9e-4a2c-90ba-190562c2aee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dc4af08-4b9e-4a2c-90ba-190562c2aee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1062738651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4acbd3c4-222d-40e0-b322-453443c52a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a98a5d5d7646ecba2b2fb5bf32417c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:31Z,use_quota=True,user_id='7367206e92cb4c7fb75a30c63f13e044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1927c3f3-e722-45cd-b6b9-0c1ca5f6836e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1927c3f3-e722-45cd-b6b9-0c1ca5f6836e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0020502-f714-408c-9b90-43c84f59fc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0020502-f714-408c-9b90-43c84f59fc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4acbd3c4-222d-40e0-b322-453443c52a8f', 'volume_name': 'volume-4acbd3c4-222d-40e0-b322-453443c52a8f', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a720f8-4586-4934-ab97-481096577f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a720f8-4586-4934-ab97-481096577f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f93804-0f93-4b02-8274-727b853ae8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:30 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Volume 4acbd3c4-222d-40e0-b322-453443c52a8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4acbd3c4-222d-40e0-b322-453443c52a8f', 'volume_size': 1} Apr 28 05:53:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:31 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dd011656-1be3-44f8-9ff0-b306012466e3 1073741824" returned: 0 in 1.024s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dd011656-1be3-44f8-9ff0-b306012466e3 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:31 devstack sudo[87484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dd011656-1be3-44f8-9ff0-b306012466e3 Apr 28 05:53:31 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:31 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dd011656-1be3-44f8-9ff0-b306012466e3" returned: 0 in 0.575s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:53:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.218s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1577606776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad55e542-64b3-4a0d-88d3-985212b482ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9126f826ab6441a89b1f11ebb7bae324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:27Z,use_quota=True,user_id='2716b5022cab43b69801b55b553db876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:53:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Creating volume ad55e542-64b3-4a0d-88d3-985212b482ac {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:53:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:53:31 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:53:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad55e542-64b3-4a0d-88d3-985212b482ac 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8c41b0-48af-4267-b382-884d17a1ec38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd011656-1be3-44f8-9ff0-b306012466e3', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8295ce-3b09-4057-829c-8a28a5e0fb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:31 devstack sudo[87488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad55e542-64b3-4a0d-88d3-985212b482ac 1073741824 Apr 28 05:53:31 devstack sudo[87488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:31 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Volume volume-dd011656-1be3-44f8-9ff0-b306012466e3 (dd011656-1be3-44f8-9ff0-b306012466e3): created successfully Apr 28 05:53:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8295ce-3b09-4057-829c-8a28a5e0fb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Flow 'volume_create_manager' (0bebd112-9739-4f18-8fa4-583cbe429a86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:32 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-77c6802e-974a-4a02-a2e1-16e295fe63d0 tempest-CreateVolumesFromImageTest-625448940 None] Created volume successfully. Apr 28 05:53:32 devstack sudo[87488]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad55e542-64b3-4a0d-88d3-985212b482ac 1073741824" returned: 0 in 0.782s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad55e542-64b3-4a0d-88d3-985212b482ac {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:32 devstack sudo[87493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad55e542-64b3-4a0d-88d3-985212b482ac Apr 28 05:53:32 devstack sudo[87493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:33 devstack sudo[87493]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad55e542-64b3-4a0d-88d3-985212b482ac" returned: 0 in 0.537s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:53:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.112s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1194487378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db5cb75-9974-4e5c-918a-a52743d143c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9126f826ab6441a89b1f11ebb7bae324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:28Z,use_quota=True,user_id='2716b5022cab43b69801b55b553db876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:53:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Creating volume 7db5cb75-9974-4e5c-918a-a52743d143c1 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:53:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:53:33 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:53:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7db5cb75-9974-4e5c-918a-a52743d143c1 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fcf0ad2-848f-47c1-8b45-202e00239a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad55e542-64b3-4a0d-88d3-985212b482ac', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00817b5b-e76a-48bf-83b8-c192ae523f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:33 devstack sudo[87499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7db5cb75-9974-4e5c-918a-a52743d143c1 1073741824 Apr 28 05:53:33 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:33 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Volume volume-ad55e542-64b3-4a0d-88d3-985212b482ac (ad55e542-64b3-4a0d-88d3-985212b482ac): created successfully Apr 28 05:53:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00817b5b-e76a-48bf-83b8-c192ae523f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Flow 'volume_create_manager' (3272491d-db80-4ef2-8781-eb18bb7da832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:33 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-1aa2ef02-63fc-4cf2-a6d7-874d32a91598 tempest-CreateVolumesFromImageTest-625448940 None] Created volume successfully. Apr 28 05:53:34 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7db5cb75-9974-4e5c-918a-a52743d143c1 1073741824" returned: 0 in 0.794s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7db5cb75-9974-4e5c-918a-a52743d143c1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:34 devstack sudo[87511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7db5cb75-9974-4e5c-918a-a52743d143c1 Apr 28 05:53:34 devstack sudo[87511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:34 devstack sudo[87511]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7db5cb75-9974-4e5c-918a-a52743d143c1" returned: 0 in 0.551s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:34 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:53:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.878s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:34 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1062738651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4acbd3c4-222d-40e0-b322-453443c52a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a98a5d5d7646ecba2b2fb5bf32417c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:31Z,use_quota=True,user_id='7367206e92cb4c7fb75a30c63f13e044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:53:34 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Creating volume 4acbd3c4-222d-40e0-b322-453443c52a8f {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:53:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:34 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:34 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:34 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:53:34 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:53:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4acbd3c4-222d-40e0-b322-453443c52a8f 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:34 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9beca87a-5e33-4112-ab01-392b87f2ea31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7db5cb75-9974-4e5c-918a-a52743d143c1', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:34 devstack sudo[87517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4acbd3c4-222d-40e0-b322-453443c52a8f 1073741824 Apr 28 05:53:34 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d23362-83fd-4b1b-9a55-50a781f553eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:34 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:34 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Volume volume-7db5cb75-9974-4e5c-918a-a52743d143c1 (7db5cb75-9974-4e5c-918a-a52743d143c1): created successfully Apr 28 05:53:34 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d23362-83fd-4b1b-9a55-50a781f553eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:34 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Flow 'volume_create_manager' (ba10a751-140b-4196-ba3e-abe258243de0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:34 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-ddddddb6-2657-4ddc-8597-58341f138b04 tempest-CreateVolumesFromImageTest-625448940 None] Created volume successfully. Apr 28 05:53:35 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4acbd3c4-222d-40e0-b322-453443c52a8f 1073741824" returned: 0 in 0.906s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4acbd3c4-222d-40e0-b322-453443c52a8f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:35 devstack sudo[87534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4acbd3c4-222d-40e0-b322-453443c52a8f Apr 28 05:53:35 devstack sudo[87534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3b027901-5cc1-4511-b6b7-db039c053804 tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "cinder-7db5cb75-9974-4e5c-918a-a52743d143c1-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3b027901-5cc1-4511-b6b7-db039c053804 tempest-CreateVolumesFromImageTest-625448940 None] Lock "cinder-7db5cb75-9974-4e5c-918a-a52743d143c1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3b027901-5cc1-4511-b6b7-db039c053804 tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "cinder-quobyte-7db5cb75-9974-4e5c-918a-a52743d143c1" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3b027901-5cc1-4511-b6b7-db039c053804 tempest-CreateVolumesFromImageTest-625448940 None] Lock "cinder-quobyte-7db5cb75-9974-4e5c-918a-a52743d143c1" acquired by "delete_volume" :: waited 0.051s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:36 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[d436c074-206b-40ec-9aca-54717557aa7b]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:53:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3b027901-5cc1-4511-b6b7-db039c053804 tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7db5cb75-9974-4e5c-918a-a52743d143c1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:36 devstack sudo[87563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7db5cb75-9974-4e5c-918a-a52743d143c1 Apr 28 05:53:36 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:36 devstack sudo[87534]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4acbd3c4-222d-40e0-b322-453443c52a8f" returned: 0 in 0.811s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:36 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:53:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:36 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f93804-0f93-4b02-8274-727b853ae8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4acbd3c4-222d-40e0-b322-453443c52a8f', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:36 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb05db2-b961-4e56-9278-518e55a8a5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:36 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Volume volume-4acbd3c4-222d-40e0-b322-453443c52a8f (4acbd3c4-222d-40e0-b322-453443c52a8f): created successfully Apr 28 05:53:36 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb05db2-b961-4e56-9278-518e55a8a5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:36 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Flow 'volume_create_manager' (ad4a46e7-9f51-41bb-928f-9688b2eee1ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:36 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-59bcfec4-6e50-4b0c-ae13-e25dda2f7f4b tempest-VolumesTransfersV357Test-102313410 None] Created volume successfully. Apr 28 05:53:37 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3b027901-5cc1-4511-b6b7-db039c053804 tempest-CreateVolumesFromImageTest-625448940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7db5cb75-9974-4e5c-918a-a52743d143c1" returned: 0 in 0.773s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3b027901-5cc1-4511-b6b7-db039c053804 tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7db5cb75-9974-4e5c-918a-a52743d143c1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:37 devstack sudo[87577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7db5cb75-9974-4e5c-918a-a52743d143c1 Apr 28 05:53:37 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:37 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3b027901-5cc1-4511-b6b7-db039c053804 tempest-CreateVolumesFromImageTest-625448940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7db5cb75-9974-4e5c-918a-a52743d143c1" returned: 0 in 0.861s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3b027901-5cc1-4511-b6b7-db039c053804 tempest-CreateVolumesFromImageTest-625448940 None] Lock "cinder-quobyte-7db5cb75-9974-4e5c-918a-a52743d143c1" released by "delete_volume" :: held 1.765s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:38 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-3b027901-5cc1-4511-b6b7-db039c053804 tempest-CreateVolumesFromImageTest-625448940 None] Created reservations ['a1bcd33a-456c-4764-af6a-36b47b83fff2', '8e7f04af-fe4e-4318-9098-4c9223624c61', 'bfe977fc-0ce4-4eb2-9534-3474e2ab90d0', '5357c818-fdcf-4456-ae3a-cd71c83114d3'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:53:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3b027901-5cc1-4511-b6b7-db039c053804 tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3b027901-5cc1-4511-b6b7-db039c053804 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:38 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3b027901-5cc1-4511-b6b7-db039c053804 tempest-CreateVolumesFromImageTest-625448940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:38 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3b027901-5cc1-4511-b6b7-db039c053804 tempest-CreateVolumesFromImageTest-625448940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3b027901-5cc1-4511-b6b7-db039c053804 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3b027901-5cc1-4511-b6b7-db039c053804 tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:38 devstack sudo[87619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:53:38 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:38 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-992274aa-b74b-46e0-9afc-9fc6ba703eb9 tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "cinder-ad55e542-64b3-4a0d-88d3-985212b482ac-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:38 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-992274aa-b74b-46e0-9afc-9fc6ba703eb9 tempest-CreateVolumesFromImageTest-625448940 None] Lock "cinder-ad55e542-64b3-4a0d-88d3-985212b482ac-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:38 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-992274aa-b74b-46e0-9afc-9fc6ba703eb9 tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "cinder-quobyte-ad55e542-64b3-4a0d-88d3-985212b482ac" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:38 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-992274aa-b74b-46e0-9afc-9fc6ba703eb9 tempest-CreateVolumesFromImageTest-625448940 None] Lock "cinder-quobyte-ad55e542-64b3-4a0d-88d3-985212b482ac" acquired by "delete_volume" :: waited 0.045s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:39 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5385af-609b-403e-9e29-9c963b71d3a8]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:53:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-992274aa-b74b-46e0-9afc-9fc6ba703eb9 tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad55e542-64b3-4a0d-88d3-985212b482ac {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:39 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-ee7708c2-3cd7-4107-825c-471f4a564d4a tempest-VolumesTransfersV357Test-122757299 None] Transfer volume completed successfully. Apr 28 05:53:39 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad55e542-64b3-4a0d-88d3-985212b482ac Apr 28 05:53:39 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:39 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3b027901-5cc1-4511-b6b7-db039c053804 tempest-CreateVolumesFromImageTest-625448940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 1.383s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:39 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-3b027901-5cc1-4511-b6b7-db039c053804 tempest-CreateVolumesFromImageTest-625448940 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:53:39 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-3b027901-5cc1-4511-b6b7-db039c053804 tempest-CreateVolumesFromImageTest-625448940 None] Deleted volume successfully. Apr 28 05:53:39 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3b027901-5cc1-4511-b6b7-db039c053804 tempest-CreateVolumesFromImageTest-625448940 None] Lock "cinder-7db5cb75-9974-4e5c-918a-a52743d143c1-delete_volume" released by "delete_volume" :: held 3.597s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:40 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-992274aa-b74b-46e0-9afc-9fc6ba703eb9 tempest-CreateVolumesFromImageTest-625448940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad55e542-64b3-4a0d-88d3-985212b482ac" returned: 0 in 1.630s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-992274aa-b74b-46e0-9afc-9fc6ba703eb9 tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad55e542-64b3-4a0d-88d3-985212b482ac {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:40 devstack sudo[87637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad55e542-64b3-4a0d-88d3-985212b482ac Apr 28 05:53:40 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b80d0106-b25d-456b-a368-592f786b3e09 tempest-VolumesTransfersV357Test-2108558738 None] Acquiring lock "cinder-4acbd3c4-222d-40e0-b322-453443c52a8f-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b80d0106-b25d-456b-a368-592f786b3e09 tempest-VolumesTransfersV357Test-2108558738 None] Lock "cinder-4acbd3c4-222d-40e0-b322-453443c52a8f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b80d0106-b25d-456b-a368-592f786b3e09 tempest-VolumesTransfersV357Test-2108558738 None] Acquiring lock "cinder-quobyte-4acbd3c4-222d-40e0-b322-453443c52a8f" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:41 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b80d0106-b25d-456b-a368-592f786b3e09 tempest-VolumesTransfersV357Test-2108558738 None] Lock "cinder-quobyte-4acbd3c4-222d-40e0-b322-453443c52a8f" acquired by "delete_volume" :: waited 0.038s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:41 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd3f262-fafc-48fc-9535-304a34ef0d28]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:53:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b80d0106-b25d-456b-a368-592f786b3e09 tempest-VolumesTransfersV357Test-2108558738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4acbd3c4-222d-40e0-b322-453443c52a8f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:41 devstack sudo[87640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4acbd3c4-222d-40e0-b322-453443c52a8f Apr 28 05:53:41 devstack sudo[87640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:41 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-992274aa-b74b-46e0-9afc-9fc6ba703eb9 tempest-CreateVolumesFromImageTest-625448940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad55e542-64b3-4a0d-88d3-985212b482ac" returned: 0 in 1.316s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:42 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-992274aa-b74b-46e0-9afc-9fc6ba703eb9 tempest-CreateVolumesFromImageTest-625448940 None] Lock "cinder-quobyte-ad55e542-64b3-4a0d-88d3-985212b482ac" released by "delete_volume" :: held 3.091s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:42 devstack sudo[87640]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b80d0106-b25d-456b-a368-592f786b3e09 tempest-VolumesTransfersV357Test-2108558738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4acbd3c4-222d-40e0-b322-453443c52a8f" returned: 0 in 1.152s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:42 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-992274aa-b74b-46e0-9afc-9fc6ba703eb9 tempest-CreateVolumesFromImageTest-625448940 None] Created reservations ['18d1c057-228b-42df-a181-cfc04fed605c', 'c552f64a-6bcf-44fe-a204-3c36b02d111b', '222723fb-34c1-47b1-838d-a55e53377238', '94dcca0f-b16c-43d4-9609-a531e1657272'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:53:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b80d0106-b25d-456b-a368-592f786b3e09 tempest-VolumesTransfersV357Test-2108558738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4acbd3c4-222d-40e0-b322-453443c52a8f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:42 devstack sudo[87647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4acbd3c4-222d-40e0-b322-453443c52a8f Apr 28 05:53:42 devstack sudo[87647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-992274aa-b74b-46e0-9afc-9fc6ba703eb9 tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-992274aa-b74b-46e0-9afc-9fc6ba703eb9 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-992274aa-b74b-46e0-9afc-9fc6ba703eb9 tempest-CreateVolumesFromImageTest-625448940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-992274aa-b74b-46e0-9afc-9fc6ba703eb9 tempest-CreateVolumesFromImageTest-625448940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-992274aa-b74b-46e0-9afc-9fc6ba703eb9 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-992274aa-b74b-46e0-9afc-9fc6ba703eb9 tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:42 devstack sudo[87649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:53:42 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:43 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-992274aa-b74b-46e0-9afc-9fc6ba703eb9 tempest-CreateVolumesFromImageTest-625448940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.665s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:43 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-992274aa-b74b-46e0-9afc-9fc6ba703eb9 tempest-CreateVolumesFromImageTest-625448940 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:53:43 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-992274aa-b74b-46e0-9afc-9fc6ba703eb9 tempest-CreateVolumesFromImageTest-625448940 None] Deleted volume successfully. Apr 28 05:53:43 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-992274aa-b74b-46e0-9afc-9fc6ba703eb9 tempest-CreateVolumesFromImageTest-625448940 None] Lock "cinder-ad55e542-64b3-4a0d-88d3-985212b482ac-delete_volume" released by "delete_volume" :: held 4.312s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:43 devstack sudo[87647]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b80d0106-b25d-456b-a368-592f786b3e09 tempest-VolumesTransfersV357Test-2108558738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4acbd3c4-222d-40e0-b322-453443c52a8f" returned: 0 in 0.908s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:43 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b80d0106-b25d-456b-a368-592f786b3e09 tempest-VolumesTransfersV357Test-2108558738 None] Lock "cinder-quobyte-4acbd3c4-222d-40e0-b322-453443c52a8f" released by "delete_volume" :: held 2.145s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:43 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-b80d0106-b25d-456b-a368-592f786b3e09 tempest-VolumesTransfersV357Test-2108558738 None] Created reservations ['a5e1719d-da94-4ef8-b935-3449a71b8af1', 'd8240799-82be-4cb4-b285-b22d07933f74', '2efc4ec5-9616-46ed-8783-bd9635664681', 'bbb1cb58-bc3f-4d07-b922-d79ec03813fc'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:53:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b80d0106-b25d-456b-a368-592f786b3e09 tempest-VolumesTransfersV357Test-2108558738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b80d0106-b25d-456b-a368-592f786b3e09 tempest-VolumesTransfersV357Test-2108558738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:43 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b80d0106-b25d-456b-a368-592f786b3e09 tempest-VolumesTransfersV357Test-2108558738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:43 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b80d0106-b25d-456b-a368-592f786b3e09 tempest-VolumesTransfersV357Test-2108558738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b80d0106-b25d-456b-a368-592f786b3e09 tempest-VolumesTransfersV357Test-2108558738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b80d0106-b25d-456b-a368-592f786b3e09 tempest-VolumesTransfersV357Test-2108558738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:43 devstack sudo[87653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:53:43 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:43 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-563e1f03-fc65-48e4-baa6-b07707e9a167 tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "cinder-dd011656-1be3-44f8-9ff0-b306012466e3-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:43 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-563e1f03-fc65-48e4-baa6-b07707e9a167 tempest-CreateVolumesFromImageTest-625448940 None] Lock "cinder-dd011656-1be3-44f8-9ff0-b306012466e3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:43 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-563e1f03-fc65-48e4-baa6-b07707e9a167 tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "cinder-quobyte-dd011656-1be3-44f8-9ff0-b306012466e3" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:43 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-563e1f03-fc65-48e4-baa6-b07707e9a167 tempest-CreateVolumesFromImageTest-625448940 None] Lock "cinder-quobyte-dd011656-1be3-44f8-9ff0-b306012466e3" acquired by "delete_volume" :: waited 0.018s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:43 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[976dad81-41c0-45ec-95f4-6356b386e42c]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:53:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-563e1f03-fc65-48e4-baa6-b07707e9a167 tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dd011656-1be3-44f8-9ff0-b306012466e3 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:44 devstack sudo[87655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dd011656-1be3-44f8-9ff0-b306012466e3 Apr 28 05:53:44 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Flow 'volume_create_manager' (9d608e99-30a6-4322-acf9-f8b1e31e8a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (049314d1-2dff-43bc-83f7-e1724ecf2ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (049314d1-2dff-43bc-83f7-e1724ecf2ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2118075500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3dfb519-a7dd-45ae-b833-74f3d5b02bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0913534fde564cb090136dbcc83b19bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:44Z,use_quota=True,user_id='c286097396d1403ebf5d733a2c724267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8abca711-fd97-458a-a1ac-fcf055b56e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8abca711-fd97-458a-a1ac-fcf055b56e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416f4cb8-f495-4943-827d-41bc4a2ae8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (416f4cb8-f495-4943-827d-41bc4a2ae8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3dfb519-a7dd-45ae-b833-74f3d5b02bf5', 'volume_name': 'volume-d3dfb519-a7dd-45ae-b833-74f3d5b02bf5', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7fec2b4-5f3c-478b-8b0a-a03a6d01b932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7fec2b4-5f3c-478b-8b0a-a03a6d01b932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c4b61ae-521f-4ee0-9f14-6d9f86970226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:44 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Volume d3dfb519-a7dd-45ae-b833-74f3d5b02bf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3dfb519-a7dd-45ae-b833-74f3d5b02bf5', 'volume_size': 1} Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2118075500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3dfb519-a7dd-45ae-b833-74f3d5b02bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0913534fde564cb090136dbcc83b19bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:44Z,use_quota=True,user_id='c286097396d1403ebf5d733a2c724267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Creating volume d3dfb519-a7dd-45ae-b833-74f3d5b02bf5 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:53:44 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3dfb519-a7dd-45ae-b833-74f3d5b02bf5 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:44 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3dfb519-a7dd-45ae-b833-74f3d5b02bf5 1073741824 Apr 28 05:53:44 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:44 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b80d0106-b25d-456b-a368-592f786b3e09 tempest-VolumesTransfersV357Test-2108558738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 1.301s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-b80d0106-b25d-456b-a368-592f786b3e09 tempest-VolumesTransfersV357Test-2108558738 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:53:44 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-b80d0106-b25d-456b-a368-592f786b3e09 tempest-VolumesTransfersV357Test-2108558738 None] Deleted volume successfully. Apr 28 05:53:44 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b80d0106-b25d-456b-a368-592f786b3e09 tempest-VolumesTransfersV357Test-2108558738 None] Lock "cinder-4acbd3c4-222d-40e0-b322-453443c52a8f-delete_volume" released by "delete_volume" :: held 3.912s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:45 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-563e1f03-fc65-48e4-baa6-b07707e9a167 tempest-CreateVolumesFromImageTest-625448940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dd011656-1be3-44f8-9ff0-b306012466e3" returned: 0 in 1.648s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-563e1f03-fc65-48e4-baa6-b07707e9a167 tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dd011656-1be3-44f8-9ff0-b306012466e3 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:45 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:53:45 devstack sudo[87666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dd011656-1be3-44f8-9ff0-b306012466e3 Apr 28 05:53:45 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Flow 'volume_create_manager' (e2bb4b6e-ac82-4f8e-ac11-a3c70f1bc1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6215a9d9-c95d-4210-9913-197be610a26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6215a9d9-c95d-4210-9913-197be610a26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-3099366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8c1902-9c1f-447f-af99-d6084d5dff2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a98a5d5d7646ecba2b2fb5bf32417c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:45Z,use_quota=True,user_id='7367206e92cb4c7fb75a30c63f13e044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236e44fe-3140-4e41-bfa0-0b7c1149b4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236e44fe-3140-4e41-bfa0-0b7c1149b4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b7860e4-edad-4640-8af0-6d058b880422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b7860e4-edad-4640-8af0-6d058b880422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f8c1902-9c1f-447f-af99-d6084d5dff2c', 'volume_name': 'volume-1f8c1902-9c1f-447f-af99-d6084d5dff2c', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd7b0de-00a5-445e-894d-39ad4bff3aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd7b0de-00a5-445e-894d-39ad4bff3aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65494b52-8388-48b5-9b55-76ab0e2d1fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:45 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Volume 1f8c1902-9c1f-447f-af99-d6084d5dff2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f8c1902-9c1f-447f-af99-d6084d5dff2c', 'volume_size': 1} Apr 28 05:53:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:45 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3dfb519-a7dd-45ae-b833-74f3d5b02bf5 1073741824" returned: 0 in 1.216s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3dfb519-a7dd-45ae-b833-74f3d5b02bf5 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:45 devstack sudo[87668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3dfb519-a7dd-45ae-b833-74f3d5b02bf5 Apr 28 05:53:45 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:46 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-563e1f03-fc65-48e4-baa6-b07707e9a167 tempest-CreateVolumesFromImageTest-625448940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dd011656-1be3-44f8-9ff0-b306012466e3" returned: 0 in 0.801s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-563e1f03-fc65-48e4-baa6-b07707e9a167 tempest-CreateVolumesFromImageTest-625448940 None] Lock "cinder-quobyte-dd011656-1be3-44f8-9ff0-b306012466e3" released by "delete_volume" :: held 2.547s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-563e1f03-fc65-48e4-baa6-b07707e9a167 tempest-CreateVolumesFromImageTest-625448940 None] Created reservations ['d31c74c0-5780-4ceb-bfd1-11d81ee3158c', '0fcc1ccb-4b42-4025-9556-bd2c534e2f4d', '141a25e0-53e6-44a6-8f67-dfd88da1d46e', 'f79f778f-ed5c-4a72-9587-3a8e474334d1'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-563e1f03-fc65-48e4-baa6-b07707e9a167 tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-563e1f03-fc65-48e4-baa6-b07707e9a167 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-563e1f03-fc65-48e4-baa6-b07707e9a167 tempest-CreateVolumesFromImageTest-625448940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-563e1f03-fc65-48e4-baa6-b07707e9a167 tempest-CreateVolumesFromImageTest-625448940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-563e1f03-fc65-48e4-baa6-b07707e9a167 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-563e1f03-fc65-48e4-baa6-b07707e9a167 tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:46 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:53:46 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:46 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3dfb519-a7dd-45ae-b833-74f3d5b02bf5" returned: 0 in 1.007s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] <== create_volume: return (2281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.290s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.143s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-3099366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8c1902-9c1f-447f-af99-d6084d5dff2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a98a5d5d7646ecba2b2fb5bf32417c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:45Z,use_quota=True,user_id='7367206e92cb4c7fb75a30c63f13e044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Creating volume 1f8c1902-9c1f-447f-af99-d6084d5dff2c {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:53:46 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f8c1902-9c1f-447f-af99-d6084d5dff2c 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c4b61ae-521f-4ee0-9f14-6d9f86970226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3dfb519-a7dd-45ae-b833-74f3d5b02bf5', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f83e89-8fd7-4784-9039-e0d2b726d413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:46 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Volume volume-d3dfb519-a7dd-45ae-b833-74f3d5b02bf5 (d3dfb519-a7dd-45ae-b833-74f3d5b02bf5): created successfully Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f83e89-8fd7-4784-9039-e0d2b726d413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:46 devstack sudo[87702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f8c1902-9c1f-447f-af99-d6084d5dff2c 1073741824 Apr 28 05:53:46 devstack sudo[87702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Flow 'volume_create_manager' (9d608e99-30a6-4322-acf9-f8b1e31e8a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:46 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-72919c24-3ce2-40f5-9c09-cbc092e9184d tempest-VolumesTransfersV355Test-1476402856 None] Created volume successfully. Apr 28 05:53:47 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4d5bb17d-e480-4210-91c2-aa43e5102bf8 tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "cinder-108b194d-f032-4aab-871c-f49fa4c0f02c-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:47 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4d5bb17d-e480-4210-91c2-aa43e5102bf8 tempest-CreateVolumesFromImageTest-625448940 None] Lock "cinder-108b194d-f032-4aab-871c-f49fa4c0f02c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:47 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4d5bb17d-e480-4210-91c2-aa43e5102bf8 tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "cinder-quobyte-108b194d-f032-4aab-871c-f49fa4c0f02c" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:47 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4d5bb17d-e480-4210-91c2-aa43e5102bf8 tempest-CreateVolumesFromImageTest-625448940 None] Lock "cinder-quobyte-108b194d-f032-4aab-871c-f49fa4c0f02c" acquired by "delete_volume" :: waited 0.036s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:47 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[812a6728-f15f-488c-9c6c-a116264ae2ef]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:53:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4d5bb17d-e480-4210-91c2-aa43e5102bf8 tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-108b194d-f032-4aab-871c-f49fa4c0f02c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:47 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:47 devstack sudo[87706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-108b194d-f032-4aab-871c-f49fa4c0f02c Apr 28 05:53:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-563e1f03-fc65-48e4-baa6-b07707e9a167 tempest-CreateVolumesFromImageTest-625448940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.849s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:47 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:47 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-563e1f03-fc65-48e4-baa6-b07707e9a167 tempest-CreateVolumesFromImageTest-625448940 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:53:47 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-563e1f03-fc65-48e4-baa6-b07707e9a167 tempest-CreateVolumesFromImageTest-625448940 None] Deleted volume successfully. Apr 28 05:53:47 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-563e1f03-fc65-48e4-baa6-b07707e9a167 tempest-CreateVolumesFromImageTest-625448940 None] Lock "cinder-dd011656-1be3-44f8-9ff0-b306012466e3-delete_volume" released by "delete_volume" :: held 3.907s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:47 devstack sudo[87702]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f8c1902-9c1f-447f-af99-d6084d5dff2c 1073741824" returned: 0 in 1.129s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f8c1902-9c1f-447f-af99-d6084d5dff2c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:48 devstack sudo[87718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f8c1902-9c1f-447f-af99-d6084d5dff2c Apr 28 05:53:48 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:48 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4d5bb17d-e480-4210-91c2-aa43e5102bf8 tempest-CreateVolumesFromImageTest-625448940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-108b194d-f032-4aab-871c-f49fa4c0f02c" returned: 0 in 0.689s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4d5bb17d-e480-4210-91c2-aa43e5102bf8 tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-108b194d-f032-4aab-871c-f49fa4c0f02c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:48 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-108b194d-f032-4aab-871c-f49fa4c0f02c Apr 28 05:53:48 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:48 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-72c48337-6045-45be-95ff-88be6a250e43 tempest-VolumesTransfersV355Test-1869832905 None] Transfer volume completed successfully. Apr 28 05:53:48 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4d5bb17d-e480-4210-91c2-aa43e5102bf8 tempest-CreateVolumesFromImageTest-625448940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-108b194d-f032-4aab-871c-f49fa4c0f02c" returned: 0 in 0.686s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:48 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4d5bb17d-e480-4210-91c2-aa43e5102bf8 tempest-CreateVolumesFromImageTest-625448940 None] Lock "cinder-quobyte-108b194d-f032-4aab-871c-f49fa4c0f02c" released by "delete_volume" :: held 1.430s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:48 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f8c1902-9c1f-447f-af99-d6084d5dff2c" returned: 0 in 0.791s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:48 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:53:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:48 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65494b52-8388-48b5-9b55-76ab0e2d1fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f8c1902-9c1f-447f-af99-d6084d5dff2c', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:48 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af46933-6083-4297-8332-b8bb3502ad7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:48 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Volume volume-1f8c1902-9c1f-447f-af99-d6084d5dff2c (1f8c1902-9c1f-447f-af99-d6084d5dff2c): created successfully Apr 28 05:53:48 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af46933-6083-4297-8332-b8bb3502ad7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:48 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Flow 'volume_create_manager' (e2bb4b6e-ac82-4f8e-ac11-a3c70f1bc1b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:48 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-d06a50f7-e866-4ce6-972c-67fdca17a8de tempest-VolumesTransfersV357Test-102313410 None] Created volume successfully. Apr 28 05:53:48 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-4d5bb17d-e480-4210-91c2-aa43e5102bf8 tempest-CreateVolumesFromImageTest-625448940 None] Created reservations ['7e3ea046-66f1-43ca-a589-73780252106e', '4f692826-cb7f-489c-ba44-730c0a90a6a8', '5df0a803-308e-4e45-bc00-eee3f0299a6e', '7f5446c0-c08f-427b-b8f4-b8c60f8d26a8'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:53:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4d5bb17d-e480-4210-91c2-aa43e5102bf8 tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4d5bb17d-e480-4210-91c2-aa43e5102bf8 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:48 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4d5bb17d-e480-4210-91c2-aa43e5102bf8 tempest-CreateVolumesFromImageTest-625448940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:48 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4d5bb17d-e480-4210-91c2-aa43e5102bf8 tempest-CreateVolumesFromImageTest-625448940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4d5bb17d-e480-4210-91c2-aa43e5102bf8 tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4d5bb17d-e480-4210-91c2-aa43e5102bf8 tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:49 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:53:49 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:49 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e362a035-89a0-4359-aced-0ae688a9b334 tempest-VolumesTransfersV355Test-1552948812 None] Acquiring lock "cinder-d3dfb519-a7dd-45ae-b833-74f3d5b02bf5-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:49 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e362a035-89a0-4359-aced-0ae688a9b334 tempest-VolumesTransfersV355Test-1552948812 None] Lock "cinder-d3dfb519-a7dd-45ae-b833-74f3d5b02bf5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:49 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e362a035-89a0-4359-aced-0ae688a9b334 tempest-VolumesTransfersV355Test-1552948812 None] Acquiring lock "cinder-quobyte-d3dfb519-a7dd-45ae-b833-74f3d5b02bf5" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:49 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e362a035-89a0-4359-aced-0ae688a9b334 tempest-VolumesTransfersV355Test-1552948812 None] Lock "cinder-quobyte-d3dfb519-a7dd-45ae-b833-74f3d5b02bf5" acquired by "delete_volume" :: waited 0.018s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:49 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dc868c-396b-408c-818a-317ac57f8877]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:53:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e362a035-89a0-4359-aced-0ae688a9b334 tempest-VolumesTransfersV355Test-1552948812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3dfb519-a7dd-45ae-b833-74f3d5b02bf5 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:49 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4d5bb17d-e480-4210-91c2-aa43e5102bf8 tempest-CreateVolumesFromImageTest-625448940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.600s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:49 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-4d5bb17d-e480-4210-91c2-aa43e5102bf8 tempest-CreateVolumesFromImageTest-625448940 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:53:49 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-4d5bb17d-e480-4210-91c2-aa43e5102bf8 tempest-CreateVolumesFromImageTest-625448940 None] Deleted volume successfully. Apr 28 05:53:49 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4d5bb17d-e480-4210-91c2-aa43e5102bf8 tempest-CreateVolumesFromImageTest-625448940 None] Lock "cinder-108b194d-f032-4aab-871c-f49fa4c0f02c-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:49 devstack sudo[87729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3dfb519-a7dd-45ae-b833-74f3d5b02bf5 Apr 28 05:53:49 devstack sudo[87729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:49 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6b2a5686-cfd1-4c39-bd2a-c6b683c35c8e tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "cinder-8aba03c5-f6da-44e1-a923-6c91ccf9e179-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:49 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6b2a5686-cfd1-4c39-bd2a-c6b683c35c8e tempest-CreateVolumesFromImageTest-625448940 None] Lock "cinder-8aba03c5-f6da-44e1-a923-6c91ccf9e179-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:49 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6b2a5686-cfd1-4c39-bd2a-c6b683c35c8e tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "cinder-quobyte-8aba03c5-f6da-44e1-a923-6c91ccf9e179" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:49 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6b2a5686-cfd1-4c39-bd2a-c6b683c35c8e tempest-CreateVolumesFromImageTest-625448940 None] Lock "cinder-quobyte-8aba03c5-f6da-44e1-a923-6c91ccf9e179" acquired by "delete_volume" :: waited 0.042s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:49 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[29faf8e8-2573-4cfe-9753-c8e8c3bd3502]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:53:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6b2a5686-cfd1-4c39-bd2a-c6b683c35c8e tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8aba03c5-f6da-44e1-a923-6c91ccf9e179 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:50 devstack sudo[87731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8aba03c5-f6da-44e1-a923-6c91ccf9e179 Apr 28 05:53:50 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e362a035-89a0-4359-aced-0ae688a9b334 tempest-VolumesTransfersV355Test-1552948812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3dfb519-a7dd-45ae-b833-74f3d5b02bf5" returned: 0 in 0.762s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e362a035-89a0-4359-aced-0ae688a9b334 tempest-VolumesTransfersV355Test-1552948812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3dfb519-a7dd-45ae-b833-74f3d5b02bf5 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:50 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0f489627-d1c7-466f-a8b8-fec21a789ee4 tempest-VolumesTransfersV357Test-2108558738 None] Acquiring lock "cinder-1f8c1902-9c1f-447f-af99-d6084d5dff2c-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:50 devstack sudo[87729]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:50 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3dfb519-a7dd-45ae-b833-74f3d5b02bf5 Apr 28 05:53:50 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0f489627-d1c7-466f-a8b8-fec21a789ee4 tempest-VolumesTransfersV357Test-2108558738 None] Lock "cinder-1f8c1902-9c1f-447f-af99-d6084d5dff2c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:50 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:50 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0f489627-d1c7-466f-a8b8-fec21a789ee4 tempest-VolumesTransfersV357Test-2108558738 None] Acquiring lock "cinder-quobyte-1f8c1902-9c1f-447f-af99-d6084d5dff2c" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:50 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0f489627-d1c7-466f-a8b8-fec21a789ee4 tempest-VolumesTransfersV357Test-2108558738 None] Lock "cinder-quobyte-1f8c1902-9c1f-447f-af99-d6084d5dff2c" acquired by "delete_volume" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:50 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[605e1328-6ca3-48df-952b-0a2b2c7527c0]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:53:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0f489627-d1c7-466f-a8b8-fec21a789ee4 tempest-VolumesTransfersV357Test-2108558738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f8c1902-9c1f-447f-af99-d6084d5dff2c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:50 devstack sudo[87740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f8c1902-9c1f-447f-af99-d6084d5dff2c Apr 28 05:53:50 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:50 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6b2a5686-cfd1-4c39-bd2a-c6b683c35c8e tempest-CreateVolumesFromImageTest-625448940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8aba03c5-f6da-44e1-a923-6c91ccf9e179" returned: 0 in 0.879s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6b2a5686-cfd1-4c39-bd2a-c6b683c35c8e tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8aba03c5-f6da-44e1-a923-6c91ccf9e179 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:50 devstack sudo[87745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8aba03c5-f6da-44e1-a923-6c91ccf9e179 Apr 28 05:53:50 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:50 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e362a035-89a0-4359-aced-0ae688a9b334 tempest-VolumesTransfersV355Test-1552948812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d3dfb519-a7dd-45ae-b833-74f3d5b02bf5" returned: 0 in 0.652s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:50 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e362a035-89a0-4359-aced-0ae688a9b334 tempest-VolumesTransfersV355Test-1552948812 None] Lock "cinder-quobyte-d3dfb519-a7dd-45ae-b833-74f3d5b02bf5" released by "delete_volume" :: held 1.460s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-e362a035-89a0-4359-aced-0ae688a9b334 tempest-VolumesTransfersV355Test-1552948812 None] Created reservations ['a2a131ea-11ac-46a6-9cf3-c2de001c7393', '968458c0-3f87-4752-9df6-bae20e35b22c', '349825a8-47df-46ab-92eb-3f486cb8bcdb', 'eee8d442-ca1b-409a-be73-ff21d0469088'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e362a035-89a0-4359-aced-0ae688a9b334 tempest-VolumesTransfersV355Test-1552948812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e362a035-89a0-4359-aced-0ae688a9b334 tempest-VolumesTransfersV355Test-1552948812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e362a035-89a0-4359-aced-0ae688a9b334 tempest-VolumesTransfersV355Test-1552948812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e362a035-89a0-4359-aced-0ae688a9b334 tempest-VolumesTransfersV355Test-1552948812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e362a035-89a0-4359-aced-0ae688a9b334 tempest-VolumesTransfersV355Test-1552948812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e362a035-89a0-4359-aced-0ae688a9b334 tempest-VolumesTransfersV355Test-1552948812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:51 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0f489627-d1c7-466f-a8b8-fec21a789ee4 tempest-VolumesTransfersV357Test-2108558738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f8c1902-9c1f-447f-af99-d6084d5dff2c" returned: 0 in 0.717s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0f489627-d1c7-466f-a8b8-fec21a789ee4 tempest-VolumesTransfersV357Test-2108558738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f8c1902-9c1f-447f-af99-d6084d5dff2c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:51 devstack sudo[87752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:53:51 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:51 devstack sudo[87753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f8c1902-9c1f-447f-af99-d6084d5dff2c Apr 28 05:53:51 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:51 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6b2a5686-cfd1-4c39-bd2a-c6b683c35c8e tempest-CreateVolumesFromImageTest-625448940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-8aba03c5-f6da-44e1-a923-6c91ccf9e179" returned: 0 in 0.629s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6b2a5686-cfd1-4c39-bd2a-c6b683c35c8e tempest-CreateVolumesFromImageTest-625448940 None] Lock "cinder-quobyte-8aba03c5-f6da-44e1-a923-6c91ccf9e179" released by "delete_volume" :: held 1.558s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-6b2a5686-cfd1-4c39-bd2a-c6b683c35c8e tempest-CreateVolumesFromImageTest-625448940 None] Created reservations ['630e4f32-23c6-4b47-95c7-bb1c4506bf88', '2281f46d-c1d3-4e94-9d89-4619ad3accbd', '0a240fdf-aa0c-4a36-88ce-aa730faf5733', '7831a830-b99a-41e6-9e72-2ee4e75694b4'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6b2a5686-cfd1-4c39-bd2a-c6b683c35c8e tempest-CreateVolumesFromImageTest-625448940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6b2a5686-cfd1-4c39-bd2a-c6b683c35c8e tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6b2a5686-cfd1-4c39-bd2a-c6b683c35c8e tempest-CreateVolumesFromImageTest-625448940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6b2a5686-cfd1-4c39-bd2a-c6b683c35c8e tempest-CreateVolumesFromImageTest-625448940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6b2a5686-cfd1-4c39-bd2a-c6b683c35c8e tempest-CreateVolumesFromImageTest-625448940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6b2a5686-cfd1-4c39-bd2a-c6b683c35c8e tempest-CreateVolumesFromImageTest-625448940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:51 devstack sudo[87757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:53:51 devstack sudo[87757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:51 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0f489627-d1c7-466f-a8b8-fec21a789ee4 tempest-VolumesTransfersV357Test-2108558738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f8c1902-9c1f-447f-af99-d6084d5dff2c" returned: 0 in 0.650s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0f489627-d1c7-466f-a8b8-fec21a789ee4 tempest-VolumesTransfersV357Test-2108558738 None] Lock "cinder-quobyte-1f8c1902-9c1f-447f-af99-d6084d5dff2c" released by "delete_volume" :: held 1.421s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-0f489627-d1c7-466f-a8b8-fec21a789ee4 tempest-VolumesTransfersV357Test-2108558738 None] Created reservations ['e414184a-b77f-47ca-83c2-7b3980bb4a5d', 'b50c6e33-d9b7-4f26-b813-5b661d459d01', '5bac036d-119b-46bc-88db-fad8b8afecd8', 'a2af2d27-1f1e-478d-bce4-8a7bbcf770c7'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:53:51 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e362a035-89a0-4359-aced-0ae688a9b334 tempest-VolumesTransfersV355Test-1552948812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.845s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:51 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-e362a035-89a0-4359-aced-0ae688a9b334 tempest-VolumesTransfersV355Test-1552948812 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:53:51 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-e362a035-89a0-4359-aced-0ae688a9b334 tempest-VolumesTransfersV355Test-1552948812 None] Deleted volume successfully. Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e362a035-89a0-4359-aced-0ae688a9b334 tempest-VolumesTransfersV355Test-1552948812 None] Lock "cinder-d3dfb519-a7dd-45ae-b833-74f3d5b02bf5-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0f489627-d1c7-466f-a8b8-fec21a789ee4 tempest-VolumesTransfersV357Test-2108558738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0f489627-d1c7-466f-a8b8-fec21a789ee4 tempest-VolumesTransfersV357Test-2108558738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-0f489627-d1c7-466f-a8b8-fec21a789ee4 tempest-VolumesTransfersV357Test-2108558738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-0f489627-d1c7-466f-a8b8-fec21a789ee4 tempest-VolumesTransfersV357Test-2108558738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0f489627-d1c7-466f-a8b8-fec21a789ee4 tempest-VolumesTransfersV357Test-2108558738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0f489627-d1c7-466f-a8b8-fec21a789ee4 tempest-VolumesTransfersV357Test-2108558738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:52 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:53:52 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:52 devstack sudo[87757]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6b2a5686-cfd1-4c39-bd2a-c6b683c35c8e tempest-CreateVolumesFromImageTest-625448940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.888s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-6b2a5686-cfd1-4c39-bd2a-c6b683c35c8e tempest-CreateVolumesFromImageTest-625448940 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:53:52 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-6b2a5686-cfd1-4c39-bd2a-c6b683c35c8e tempest-CreateVolumesFromImageTest-625448940 None] Deleted volume successfully. Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6b2a5686-cfd1-4c39-bd2a-c6b683c35c8e tempest-CreateVolumesFromImageTest-625448940 None] Lock "cinder-8aba03c5-f6da-44e1-a923-6c91ccf9e179-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Flow 'volume_create_manager' (1173cbf5-f77c-48d6-a048-41d2add964a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec0d2da8-7fb4-4960-9e28-381ed31f6adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec0d2da8-7fb4-4960-9e28-381ed31f6adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-421749616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e8f212-b214-4428-a70a-26c9a25aa97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0913534fde564cb090136dbcc83b19bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:53Z,use_quota=True,user_id='c286097396d1403ebf5d733a2c724267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649881e5-1850-4858-a8f0-d3a9a79c728d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649881e5-1850-4858-a8f0-d3a9a79c728d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306c0ffa-1803-4ebb-b4b6-d2314ba96f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306c0ffa-1803-4ebb-b4b6-d2314ba96f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2e8f212-b214-4428-a70a-26c9a25aa97d', 'volume_name': 'volume-c2e8f212-b214-4428-a70a-26c9a25aa97d', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce92dd15-0059-4fde-b9b2-8c0039eb72fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce92dd15-0059-4fde-b9b2-8c0039eb72fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9142c6-d1ac-4852-b2b9-aea5e9741d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:52 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Volume c2e8f212-b214-4428-a70a-26c9a25aa97d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2e8f212-b214-4428-a70a-26c9a25aa97d', 'volume_size': 1} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-421749616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e8f212-b214-4428-a70a-26c9a25aa97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0913534fde564cb090136dbcc83b19bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:53Z,use_quota=True,user_id='c286097396d1403ebf5d733a2c724267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Creating volume c2e8f212-b214-4428-a70a-26c9a25aa97d {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:53:52 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:53:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c2e8f212-b214-4428-a70a-26c9a25aa97d 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:52 devstack sudo[87780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c2e8f212-b214-4428-a70a-26c9a25aa97d 1073741824 Apr 28 05:53:52 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:53 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0f489627-d1c7-466f-a8b8-fec21a789ee4 tempest-VolumesTransfersV357Test-2108558738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 1.383s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:53 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-0f489627-d1c7-466f-a8b8-fec21a789ee4 tempest-VolumesTransfersV357Test-2108558738 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:53:53 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-0f489627-d1c7-466f-a8b8-fec21a789ee4 tempest-VolumesTransfersV357Test-2108558738 None] Deleted volume successfully. Apr 28 05:53:53 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0f489627-d1c7-466f-a8b8-fec21a789ee4 tempest-VolumesTransfersV357Test-2108558738 None] Lock "cinder-1f8c1902-9c1f-447f-af99-d6084d5dff2c-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:54 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c2e8f212-b214-4428-a70a-26c9a25aa97d 1073741824" returned: 0 in 1.706s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:54 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:SELECT=140,cinder:INSERT=43,cinder:UPDATE=220,cinder:DELETE=18 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:53:54 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:UPDATE=207,cinder:SELECT=148,cinder:INSERT=58,cinder:DELETE=18 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:53:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c2e8f212-b214-4428-a70a-26c9a25aa97d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:54 devstack sudo[87849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c2e8f212-b214-4428-a70a-26c9a25aa97d Apr 28 05:53:54 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:55 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c2e8f212-b214-4428-a70a-26c9a25aa97d" returned: 0 in 0.695s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:55 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] <== create_volume: return (2478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:53:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.496s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:55 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9142c6-d1ac-4852-b2b9-aea5e9741d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2e8f212-b214-4428-a70a-26c9a25aa97d', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:55 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e149f10e-5341-4875-86e6-1eb9a66ccc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:55 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Volume volume-c2e8f212-b214-4428-a70a-26c9a25aa97d (c2e8f212-b214-4428-a70a-26c9a25aa97d): created successfully Apr 28 05:53:55 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e149f10e-5341-4875-86e6-1eb9a66ccc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:55 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Flow 'volume_create_manager' (1173cbf5-f77c-48d6-a048-41d2add964a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:55 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-902d7f0d-2a1f-4e98-afaa-03e9127d26d6 tempest-VolumesTransfersV355Test-1476402856 None] Created volume successfully. Apr 28 05:53:56 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3fde92dd-b9a6-45ea-8268-d05b024edde8 tempest-VolumesTransfersV355Test-1552948812 None] Acquiring lock "cinder-c2e8f212-b214-4428-a70a-26c9a25aa97d-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:56 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3fde92dd-b9a6-45ea-8268-d05b024edde8 tempest-VolumesTransfersV355Test-1552948812 None] Lock "cinder-c2e8f212-b214-4428-a70a-26c9a25aa97d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:56 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3fde92dd-b9a6-45ea-8268-d05b024edde8 tempest-VolumesTransfersV355Test-1552948812 None] Acquiring lock "cinder-quobyte-c2e8f212-b214-4428-a70a-26c9a25aa97d" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3fde92dd-b9a6-45ea-8268-d05b024edde8 tempest-VolumesTransfersV355Test-1552948812 None] Lock "cinder-quobyte-c2e8f212-b214-4428-a70a-26c9a25aa97d" acquired by "delete_volume" :: waited 0.048s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[9297df0f-4e55-49a7-81ac-dd1445667eab]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3fde92dd-b9a6-45ea-8268-d05b024edde8 tempest-VolumesTransfersV355Test-1552948812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c2e8f212-b214-4428-a70a-26c9a25aa97d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:53:57 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c2e8f212-b214-4428-a70a-26c9a25aa97d Apr 28 05:53:57 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Flow 'volume_create_manager' (f2b3ad4d-cf73-4b2f-a43b-ddc7fc276b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e40680-4ee1-414a-a9ff-f0f59e39f883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e40680-4ee1-414a-a9ff-f0f59e39f883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-821405166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e20da1-f513-404b-856a-1cb1c162d0c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bada94a7f91f4b2f9f1ea9b3d4820b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:57Z,use_quota=True,user_id='d62502fa623e4f589d0c55b5ec918505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7072112c-5591-4096-b1c5-8d8faabc6059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7072112c-5591-4096-b1c5-8d8faabc6059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a650ae72-43dc-49af-8b5a-1a7fad37877e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a650ae72-43dc-49af-8b5a-1a7fad37877e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5e20da1-f513-404b-856a-1cb1c162d0c9', 'volume_name': 'volume-d5e20da1-f513-404b-856a-1cb1c162d0c9', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c51d0a1-959b-42b5-b05c-33f33d46833e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c51d0a1-959b-42b5-b05c-33f33d46833e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642210d9-4789-4bae-bc98-dc68bf4ed543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:57 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Volume d5e20da1-f513-404b-856a-1cb1c162d0c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5e20da1-f513-404b-856a-1cb1c162d0c9', 'volume_size': 1} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-821405166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e20da1-f513-404b-856a-1cb1c162d0c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bada94a7f91f4b2f9f1ea9b3d4820b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:57Z,use_quota=True,user_id='d62502fa623e4f589d0c55b5ec918505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Creating volume d5e20da1-f513-404b-856a-1cb1c162d0c9 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:53:57 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:53:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d5e20da1-f513-404b-856a-1cb1c162d0c9 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:57 devstack sudo[87874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d5e20da1-f513-404b-856a-1cb1c162d0c9 1073741824 Apr 28 05:53:57 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:58 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3fde92dd-b9a6-45ea-8268-d05b024edde8 tempest-VolumesTransfersV355Test-1552948812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c2e8f212-b214-4428-a70a-26c9a25aa97d" returned: 0 in 1.266s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3fde92dd-b9a6-45ea-8268-d05b024edde8 tempest-VolumesTransfersV355Test-1552948812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c2e8f212-b214-4428-a70a-26c9a25aa97d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:58 devstack sudo[87880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c2e8f212-b214-4428-a70a-26c9a25aa97d Apr 28 05:53:58 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:58 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:53:58 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Flow 'volume_create_manager' (ab9e0766-3430-40cd-89c6-edfcd9713f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:58 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75db5dca-0a59-4c6e-82ee-5c2ae32dbc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:58 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75db5dca-0a59-4c6e-82ee-5c2ae32dbc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1545692949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccbfcf9e-6b25-459e-87eb-da144aded0ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1d6c34b88344d19100866064f845e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:59Z,use_quota=True,user_id='a04299a2eeff47eeb87c66187518365b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:58 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff9a324-e108-497e-93c9-676c1d115468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:58 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff9a324-e108-497e-93c9-676c1d115468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:58 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4c8e6f-827e-413b-8617-3e8f6e458540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:58 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4c8e6f-827e-413b-8617-3e8f6e458540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccbfcf9e-6b25-459e-87eb-da144aded0ad', 'volume_name': 'volume-ccbfcf9e-6b25-459e-87eb-da144aded0ad', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:58 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cf2a534-c374-43d3-a02a-7dd81cb1edeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:58 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cf2a534-c374-43d3-a02a-7dd81cb1edeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:58 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f6b40f-ada4-402e-a4f2-0a51967202b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:58 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Volume ccbfcf9e-6b25-459e-87eb-da144aded0ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccbfcf9e-6b25-459e-87eb-da144aded0ad', 'volume_size': 1} Apr 28 05:53:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:58 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d5e20da1-f513-404b-856a-1cb1c162d0c9 1073741824" returned: 0 in 1.234s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d5e20da1-f513-404b-856a-1cb1c162d0c9 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:58 devstack sudo[87885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d5e20da1-f513-404b-856a-1cb1c162d0c9 Apr 28 05:53:58 devstack sudo[87885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:59 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3fde92dd-b9a6-45ea-8268-d05b024edde8 tempest-VolumesTransfersV355Test-1552948812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c2e8f212-b214-4428-a70a-26c9a25aa97d" returned: 0 in 0.965s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3fde92dd-b9a6-45ea-8268-d05b024edde8 tempest-VolumesTransfersV355Test-1552948812 None] Lock "cinder-quobyte-c2e8f212-b214-4428-a70a-26c9a25aa97d" released by "delete_volume" :: held 2.338s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-3fde92dd-b9a6-45ea-8268-d05b024edde8 tempest-VolumesTransfersV355Test-1552948812 None] Created reservations ['5a3b87cd-55f3-45fd-ba03-d7327aeccc4b', 'a19ad8da-d482-437f-b56e-bc605e3adf5c', '5d60ad9e-1f0a-4b2b-bbaa-d74d16493325', 'a4b58151-315e-4492-a32c-f790fe4831e6'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3fde92dd-b9a6-45ea-8268-d05b024edde8 tempest-VolumesTransfersV355Test-1552948812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3fde92dd-b9a6-45ea-8268-d05b024edde8 tempest-VolumesTransfersV355Test-1552948812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3fde92dd-b9a6-45ea-8268-d05b024edde8 tempest-VolumesTransfersV355Test-1552948812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3fde92dd-b9a6-45ea-8268-d05b024edde8 tempest-VolumesTransfersV355Test-1552948812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3fde92dd-b9a6-45ea-8268-d05b024edde8 tempest-VolumesTransfersV355Test-1552948812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3fde92dd-b9a6-45ea-8268-d05b024edde8 tempest-VolumesTransfersV355Test-1552948812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:59 devstack sudo[87889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:53:59 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:59 devstack sudo[87885]: pam_unix(sudo:session): session closed for user root Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d5e20da1-f513-404b-856a-1cb1c162d0c9" returned: 0 in 0.814s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] <== create_volume: return (2174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.179s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.931s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1545692949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccbfcf9e-6b25-459e-87eb-da144aded0ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1d6c34b88344d19100866064f845e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:53:59Z,use_quota=True,user_id='a04299a2eeff47eeb87c66187518365b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Creating volume ccbfcf9e-6b25-459e-87eb-da144aded0ad {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:53:59 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccbfcf9e-6b25-459e-87eb-da144aded0ad 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642210d9-4789-4bae-bc98-dc68bf4ed543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5e20da1-f513-404b-856a-1cb1c162d0c9', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9008f34-3e1c-4b15-9e33-5e6dae0ee816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:53:59 devstack sudo[87891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccbfcf9e-6b25-459e-87eb-da144aded0ad 1073741824 Apr 28 05:53:59 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Volume volume-d5e20da1-f513-404b-856a-1cb1c162d0c9 (d5e20da1-f513-404b-856a-1cb1c162d0c9): created successfully Apr 28 05:53:59 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9008f34-3e1c-4b15-9e33-5e6dae0ee816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:53:59 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Flow 'volume_create_manager' (f2b3ad4d-cf73-4b2f-a43b-ddc7fc276b9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:53:59 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-aeb3c407-6c83-4a35-b45b-d3743bf75420 tempest-ServerRescueNegativeTestJSON-913272488 None] Created volume successfully. Apr 28 05:54:00 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3fde92dd-b9a6-45ea-8268-d05b024edde8 tempest-VolumesTransfersV355Test-1552948812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.664s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:00 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-3fde92dd-b9a6-45ea-8268-d05b024edde8 tempest-VolumesTransfersV355Test-1552948812 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:54:00 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-3fde92dd-b9a6-45ea-8268-d05b024edde8 tempest-VolumesTransfersV355Test-1552948812 None] Deleted volume successfully. Apr 28 05:54:00 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3fde92dd-b9a6-45ea-8268-d05b024edde8 tempest-VolumesTransfersV355Test-1552948812 None] Lock "cinder-c2e8f212-b214-4428-a70a-26c9a25aa97d-delete_volume" released by "delete_volume" :: held 3.428s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:54:00 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccbfcf9e-6b25-459e-87eb-da144aded0ad 1073741824" returned: 0 in 1.019s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccbfcf9e-6b25-459e-87eb-da144aded0ad {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:00 devstack sudo[87898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccbfcf9e-6b25-459e-87eb-da144aded0ad Apr 28 05:54:00 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:01 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccbfcf9e-6b25-459e-87eb-da144aded0ad" returned: 0 in 0.932s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:54:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f6b40f-ada4-402e-a4f2-0a51967202b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccbfcf9e-6b25-459e-87eb-da144aded0ad', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142f4203-7f0f-4e57-a940-5e816d2e9454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:01 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Volume volume-ccbfcf9e-6b25-459e-87eb-da144aded0ad (ccbfcf9e-6b25-459e-87eb-da144aded0ad): created successfully Apr 28 05:54:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142f4203-7f0f-4e57-a940-5e816d2e9454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Flow 'volume_create_manager' (ab9e0766-3430-40cd-89c6-edfcd9713f36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:54:01 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-af2c7192-449f-44ea-b78f-963174f62257 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Created volume successfully. Apr 28 05:54:02 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:54:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Flow 'volume_create_manager' (fafdeacf-c402-44b2-a024-57c0191aaa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:54:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b686c424-e6ef-4fda-831c-8455ed16fe2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b686c424-e6ef-4fda-831c-8455ed16fe2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1842615952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b9f46a-cce6-439b-a61c-b7e24181cf73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1d6c34b88344d19100866064f845e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:54:03Z,use_quota=True,user_id='a04299a2eeff47eeb87c66187518365b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5084b5-1e96-4121-b322-5c36c33195e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5084b5-1e96-4121-b322-5c36c33195e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4950e9c6-fce1-4794-9e9f-8a3850727d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4950e9c6-fce1-4794-9e9f-8a3850727d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8b9f46a-cce6-439b-a61c-b7e24181cf73', 'volume_name': 'volume-c8b9f46a-cce6-439b-a61c-b7e24181cf73', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6665e83-ab1b-4b8a-a0ec-67fa08b3f138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6665e83-ab1b-4b8a-a0ec-67fa08b3f138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8305e1-9949-4c27-ad2d-fb22c612f923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:02 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Volume c8b9f46a-cce6-439b-a61c-b7e24181cf73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8b9f46a-cce6-439b-a61c-b7e24181cf73', 'volume_size': 1} Apr 28 05:54:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:02 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1842615952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b9f46a-cce6-439b-a61c-b7e24181cf73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1d6c34b88344d19100866064f845e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:54:03Z,use_quota=True,user_id='a04299a2eeff47eeb87c66187518365b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:54:02 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Creating volume c8b9f46a-cce6-439b-a61c-b7e24181cf73 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:54:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:02 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:54:03 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c8b9f46a-cce6-439b-a61c-b7e24181cf73 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:03 devstack sudo[87902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c8b9f46a-cce6-439b-a61c-b7e24181cf73 1073741824 Apr 28 05:54:03 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Flow 'volume_create_manager' (dde70c27-a4a6-490a-a7b7-645aa090e7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf5260f-4eab-4cc3-8eaa-ea4ecd821cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf5260f-4eab-4cc3-8eaa-ea4ecd821cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-52705329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d5de37-661f-4932-a69c-418a7186aab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1d6c34b88344d19100866064f845e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:54:03Z,use_quota=True,user_id='a04299a2eeff47eeb87c66187518365b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd238e8-273b-481b-bafc-6e23ad6593e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd238e8-273b-481b-bafc-6e23ad6593e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9acc71-e649-40a8-b21f-eea2cc183453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9acc71-e649-40a8-b21f-eea2cc183453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d5de37-661f-4932-a69c-418a7186aab6', 'volume_name': 'volume-76d5de37-661f-4932-a69c-418a7186aab6', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f26b64-16dd-4400-a72c-cb66f4f5ffbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f26b64-16dd-4400-a72c-cb66f4f5ffbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42af57c9-e0b6-4f3f-bb64-cea11023afce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:03 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Volume 76d5de37-661f-4932-a69c-418a7186aab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d5de37-661f-4932-a69c-418a7186aab6', 'volume_size': 1} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Flow 'volume_create_manager' (e0aaa1f0-114d-4733-97ef-b6864b1af11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87631f4d-fc7c-4aa6-8a69-88fe3f3872f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87631f4d-fc7c-4aa6-8a69-88fe3f3872f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-574379485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78bf80d-6810-4797-9c77-fd6ac7f687be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1d6c34b88344d19100866064f845e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:54:04Z,use_quota=True,user_id='a04299a2eeff47eeb87c66187518365b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf08d33d-e64b-473c-9138-887937ae347d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf08d33d-e64b-473c-9138-887937ae347d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4331ccd8-8419-40be-99c6-3b42e8a10275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4331ccd8-8419-40be-99c6-3b42e8a10275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c78bf80d-6810-4797-9c77-fd6ac7f687be', 'volume_name': 'volume-c78bf80d-6810-4797-9c77-fd6ac7f687be', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b11cc0-7ecf-4711-9256-ab4840f5d326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b11cc0-7ecf-4711-9256-ab4840f5d326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373037fa-f149-444f-812c-9d26fef9a914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:04 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Volume c78bf80d-6810-4797-9c77-fd6ac7f687be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c78bf80d-6810-4797-9c77-fd6ac7f687be', 'volume_size': 1} Apr 28 05:54:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:04 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c8b9f46a-cce6-439b-a61c-b7e24181cf73 1073741824" returned: 0 in 1.049s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c8b9f46a-cce6-439b-a61c-b7e24181cf73 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:04 devstack sudo[87907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c8b9f46a-cce6-439b-a61c-b7e24181cf73 Apr 28 05:54:04 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:04 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:54:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Flow 'volume_create_manager' (a398fb9f-4198-459a-bbc4-0c981d9e69b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:54:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cfa2204-f89c-44bf-9a20-dcedcbf221b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cfa2204-f89c-44bf-9a20-dcedcbf221b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1022503846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad0d4c37-72fe-409a-ad62-e53dabf12015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1d6c34b88344d19100866064f845e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:54:04Z,use_quota=True,user_id='a04299a2eeff47eeb87c66187518365b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcf5a89-b18b-47da-a5a8-5c6d0ddf03e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcf5a89-b18b-47da-a5a8-5c6d0ddf03e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc85ab5-b859-419d-bd43-1a7917a2de85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc85ab5-b859-419d-bd43-1a7917a2de85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad0d4c37-72fe-409a-ad62-e53dabf12015', 'volume_name': 'volume-ad0d4c37-72fe-409a-ad62-e53dabf12015', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb3aeaa0-e16b-4677-a572-7f3623b6f85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb3aeaa0-e16b-4677-a572-7f3623b6f85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dcde1f1-2aa6-4483-a626-819807217320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:04 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Volume ad0d4c37-72fe-409a-ad62-e53dabf12015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad0d4c37-72fe-409a-ad62-e53dabf12015', 'volume_size': 1} Apr 28 05:54:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:04 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Flow 'volume_create_manager' (9123cf04-5a3a-4000-8ee6-785a75dee474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f610fab2-344c-4bb5-a1cb-6a72933e501a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c8b9f46a-cce6-439b-a61c-b7e24181cf73" returned: 0 in 0.934s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] <== create_volume: return (2065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.416s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-52705329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d5de37-661f-4932-a69c-418a7186aab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1d6c34b88344d19100866064f845e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:54:03Z,use_quota=True,user_id='a04299a2eeff47eeb87c66187518365b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Creating volume 76d5de37-661f-4932-a69c-418a7186aab6 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:54:05 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-76d5de37-661f-4932-a69c-418a7186aab6 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f610fab2-344c-4bb5-a1cb-6a72933e501a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1200927309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556007f6-4f57-4330-ba73-1f070fda034a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1d6c34b88344d19100866064f845e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:54:05Z,use_quota=True,user_id='a04299a2eeff47eeb87c66187518365b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:05 devstack sudo[87910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-76d5de37-661f-4932-a69c-418a7186aab6 1073741824 Apr 28 05:54:05 devstack sudo[87910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1a5c55-2df8-4a74-8bef-a3db76c028a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1a5c55-2df8-4a74-8bef-a3db76c028a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3cb2ca-b914-46ac-9d94-5812e079f753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3cb2ca-b914-46ac-9d94-5812e079f753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '556007f6-4f57-4330-ba73-1f070fda034a', 'volume_name': 'volume-556007f6-4f57-4330-ba73-1f070fda034a', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88a2ad1-1c2b-49ca-a1c7-da6cd6848185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88a2ad1-1c2b-49ca-a1c7-da6cd6848185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3609b4f-54a8-47b5-b197-433899f87824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:05 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Volume 556007f6-4f57-4330-ba73-1f070fda034a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-556007f6-4f57-4330-ba73-1f070fda034a', 'volume_size': 1} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8305e1-9949-4c27-ad2d-fb22c612f923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8b9f46a-cce6-439b-a61c-b7e24181cf73', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ce5245e-8516-4604-bf2b-ab121b6e10d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:05 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Volume volume-c8b9f46a-cce6-439b-a61c-b7e24181cf73 (c8b9f46a-cce6-439b-a61c-b7e24181cf73): created successfully Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ce5245e-8516-4604-bf2b-ab121b6e10d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:05 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Flow 'volume_create_manager' (fafdeacf-c402-44b2-a024-57c0191aaa71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:54:05 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-d9fcfcdf-f02f-4954-a616-c799c3a76375 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Created volume successfully. Apr 28 05:54:06 devstack sudo[87910]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-76d5de37-661f-4932-a69c-418a7186aab6 1073741824" returned: 0 in 1.156s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-76d5de37-661f-4932-a69c-418a7186aab6 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:06 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-76d5de37-661f-4932-a69c-418a7186aab6 Apr 28 05:54:06 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:06 devstack cinder-volume[81829]: DEBUG oslo_service.periodic_task [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81829) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 05:54:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:54:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:54:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:07 devstack sudo[87958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:54:07 devstack sudo[87958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:07 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-76d5de37-661f-4932-a69c-418a7186aab6" returned: 0 in 0.935s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:07 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] <== create_volume: return (2148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:54:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.154s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.236s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:07 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-574379485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78bf80d-6810-4797-9c77-fd6ac7f687be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1d6c34b88344d19100866064f845e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:54:04Z,use_quota=True,user_id='a04299a2eeff47eeb87c66187518365b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:54:07 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Creating volume c78bf80d-6810-4797-9c77-fd6ac7f687be {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:54:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:07 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:54:07 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:54:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:07 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:54:07 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:54:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c78bf80d-6810-4797-9c77-fd6ac7f687be 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:07 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42af57c9-e0b6-4f3f-bb64-cea11023afce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d5de37-661f-4932-a69c-418a7186aab6', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:07 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f0bf57b-154a-4aa1-a89f-10265b960e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:07 devstack sudo[87960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c78bf80d-6810-4797-9c77-fd6ac7f687be 1073741824 Apr 28 05:54:07 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:07 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Volume volume-76d5de37-661f-4932-a69c-418a7186aab6 (76d5de37-661f-4932-a69c-418a7186aab6): created successfully Apr 28 05:54:07 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f0bf57b-154a-4aa1-a89f-10265b960e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:07 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Flow 'volume_create_manager' (dde70c27-a4a6-490a-a7b7-645aa090e7ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:54:07 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-4ebaac5b-1b62-4887-9548-f3ecbd1d02bd tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Created volume successfully. Apr 28 05:54:07 devstack sudo[87958]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.926s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:07 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:54:08 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c78bf80d-6810-4797-9c77-fd6ac7f687be 1073741824" returned: 0 in 1.198s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c78bf80d-6810-4797-9c77-fd6ac7f687be {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:08 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c78bf80d-6810-4797-9c77-fd6ac7f687be Apr 28 05:54:08 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:09 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c78bf80d-6810-4797-9c77-fd6ac7f687be" returned: 0 in 0.693s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:54:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.519s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1022503846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad0d4c37-72fe-409a-ad62-e53dabf12015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1d6c34b88344d19100866064f845e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:54:04Z,use_quota=True,user_id='a04299a2eeff47eeb87c66187518365b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:54:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Creating volume ad0d4c37-72fe-409a-ad62-e53dabf12015 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:54:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:54:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:54:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:54:09 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:54:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad0d4c37-72fe-409a-ad62-e53dabf12015 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:09 devstack sudo[88001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad0d4c37-72fe-409a-ad62-e53dabf12015 1073741824 Apr 28 05:54:09 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373037fa-f149-444f-812c-9d26fef9a914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c78bf80d-6810-4797-9c77-fd6ac7f687be', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03805da3-1e3c-4ceb-be00-269f997da663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:09 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Volume volume-c78bf80d-6810-4797-9c77-fd6ac7f687be (c78bf80d-6810-4797-9c77-fd6ac7f687be): created successfully Apr 28 05:54:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03805da3-1e3c-4ceb-be00-269f997da663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Flow 'volume_create_manager' (e0aaa1f0-114d-4733-97ef-b6864b1af11f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:54:09 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-4fce72ff-d0e8-45cf-a999-7ff29ef4334e tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Created volume successfully. Apr 28 05:54:10 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad0d4c37-72fe-409a-ad62-e53dabf12015 1073741824" returned: 0 in 0.959s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad0d4c37-72fe-409a-ad62-e53dabf12015 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:10 devstack sudo[88011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad0d4c37-72fe-409a-ad62-e53dabf12015 Apr 28 05:54:10 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:10 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad0d4c37-72fe-409a-ad62-e53dabf12015" returned: 0 in 0.559s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:10 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:54:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.505s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:10 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1200927309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556007f6-4f57-4330-ba73-1f070fda034a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1d6c34b88344d19100866064f845e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:54:05Z,use_quota=True,user_id='a04299a2eeff47eeb87c66187518365b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:54:10 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Creating volume 556007f6-4f57-4330-ba73-1f070fda034a {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:54:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:10 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:54:10 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:54:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:10 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:54:10 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:54:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-556007f6-4f57-4330-ba73-1f070fda034a 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dcde1f1-2aa6-4483-a626-819807217320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad0d4c37-72fe-409a-ad62-e53dabf12015', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef327b9-6661-4f86-bc22-3faa3736ef89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:10 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Volume volume-ad0d4c37-72fe-409a-ad62-e53dabf12015 (ad0d4c37-72fe-409a-ad62-e53dabf12015): created successfully Apr 28 05:54:10 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-556007f6-4f57-4330-ba73-1f070fda034a 1073741824 Apr 28 05:54:10 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef327b9-6661-4f86-bc22-3faa3736ef89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Flow 'volume_create_manager' (a398fb9f-4198-459a-bbc4-0c981d9e69b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:54:10 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-ac770244-9324-4427-8538-f3651d68b544 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Created volume successfully. Apr 28 05:54:11 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-556007f6-4f57-4330-ba73-1f070fda034a 1073741824" returned: 0 in 0.921s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-556007f6-4f57-4330-ba73-1f070fda034a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:11 devstack sudo[88022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-556007f6-4f57-4330-ba73-1f070fda034a Apr 28 05:54:11 devstack sudo[88022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:12 devstack sudo[88022]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-556007f6-4f57-4330-ba73-1f070fda034a" returned: 0 in 0.630s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:12 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:54:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:12 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3609b4f-54a8-47b5-b197-433899f87824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-556007f6-4f57-4330-ba73-1f070fda034a', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:12 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3a04af-4d0a-4d64-a2cc-79da3fa52f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:12 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Volume volume-556007f6-4f57-4330-ba73-1f070fda034a (556007f6-4f57-4330-ba73-1f070fda034a): created successfully Apr 28 05:54:12 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3a04af-4d0a-4d64-a2cc-79da3fa52f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:12 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Flow 'volume_create_manager' (9123cf04-5a3a-4000-8ee6-785a75dee474) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:54:12 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-cb1b76a7-3adb-4c16-92af-dab4d7039ab7 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Created volume successfully. Apr 28 05:54:13 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ba782bfe-54f5-4c80-82b0-a6fddfd584a9 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "cinder-556007f6-4f57-4330-ba73-1f070fda034a-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:54:13 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ba782bfe-54f5-4c80-82b0-a6fddfd584a9 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-556007f6-4f57-4330-ba73-1f070fda034a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:54:13 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ba782bfe-54f5-4c80-82b0-a6fddfd584a9 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "cinder-quobyte-556007f6-4f57-4330-ba73-1f070fda034a" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:54:13 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ba782bfe-54f5-4c80-82b0-a6fddfd584a9 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-quobyte-556007f6-4f57-4330-ba73-1f070fda034a" acquired by "delete_volume" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:54:13 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[613e8765-32ad-4b02-b62b-dca0226729a5]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:54:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ba782bfe-54f5-4c80-82b0-a6fddfd584a9 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-556007f6-4f57-4330-ba73-1f070fda034a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:13 devstack sudo[88029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-556007f6-4f57-4330-ba73-1f070fda034a Apr 28 05:54:13 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:14 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ba782bfe-54f5-4c80-82b0-a6fddfd584a9 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-556007f6-4f57-4330-ba73-1f070fda034a" returned: 0 in 0.786s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ba782bfe-54f5-4c80-82b0-a6fddfd584a9 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-556007f6-4f57-4330-ba73-1f070fda034a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:14 devstack sudo[88041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-556007f6-4f57-4330-ba73-1f070fda034a Apr 28 05:54:14 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:14 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ba782bfe-54f5-4c80-82b0-a6fddfd584a9 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-556007f6-4f57-4330-ba73-1f070fda034a" returned: 0 in 0.706s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:14 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ba782bfe-54f5-4c80-82b0-a6fddfd584a9 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-quobyte-556007f6-4f57-4330-ba73-1f070fda034a" released by "delete_volume" :: held 1.556s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:54:14 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-ba782bfe-54f5-4c80-82b0-a6fddfd584a9 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Created reservations ['ed22a3c9-1422-495f-95f5-15324acc7150', '1b9f213d-2f95-4d08-8c5e-d039daaa6994', '4bdae3bf-6f96-4369-bf64-75be94db6256', '9731437b-e308-494d-84b5-24c35e300888'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:54:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ba782bfe-54f5-4c80-82b0-a6fddfd584a9 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ba782bfe-54f5-4c80-82b0-a6fddfd584a9 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:14 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ba782bfe-54f5-4c80-82b0-a6fddfd584a9 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:54:14 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ba782bfe-54f5-4c80-82b0-a6fddfd584a9 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:54:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ba782bfe-54f5-4c80-82b0-a6fddfd584a9 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ba782bfe-54f5-4c80-82b0-a6fddfd584a9 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:14 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:54:15 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f3eecb7b-78e2-4e68-a6dc-fadc5edeab41 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "cinder-ad0d4c37-72fe-409a-ad62-e53dabf12015-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:54:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f3eecb7b-78e2-4e68-a6dc-fadc5edeab41 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-ad0d4c37-72fe-409a-ad62-e53dabf12015-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:54:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f3eecb7b-78e2-4e68-a6dc-fadc5edeab41 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "cinder-quobyte-ad0d4c37-72fe-409a-ad62-e53dabf12015" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:54:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f3eecb7b-78e2-4e68-a6dc-fadc5edeab41 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-quobyte-ad0d4c37-72fe-409a-ad62-e53dabf12015" acquired by "delete_volume" :: waited 0.029s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:54:15 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ba782bfe-54f5-4c80-82b0-a6fddfd584a9 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.881s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:15 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-ba782bfe-54f5-4c80-82b0-a6fddfd584a9 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:54:15 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-ba782bfe-54f5-4c80-82b0-a6fddfd584a9 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Deleted volume successfully. Apr 28 05:54:15 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[1389eeea-dda9-4ae9-8d14-81a32b8d2eaf]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:54:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f3eecb7b-78e2-4e68-a6dc-fadc5edeab41 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad0d4c37-72fe-409a-ad62-e53dabf12015 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:16 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ba782bfe-54f5-4c80-82b0-a6fddfd584a9 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-556007f6-4f57-4330-ba73-1f070fda034a-delete_volume" released by "delete_volume" :: held 2.867s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:54:16 devstack sudo[88082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad0d4c37-72fe-409a-ad62-e53dabf12015 Apr 28 05:54:16 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:16 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f3eecb7b-78e2-4e68-a6dc-fadc5edeab41 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad0d4c37-72fe-409a-ad62-e53dabf12015" returned: 0 in 1.008s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f3eecb7b-78e2-4e68-a6dc-fadc5edeab41 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad0d4c37-72fe-409a-ad62-e53dabf12015 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:16 devstack sudo[88087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad0d4c37-72fe-409a-ad62-e53dabf12015 Apr 28 05:54:16 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:17 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:54:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Flow 'volume_create_manager' (492cb7d9-f7b8-474f-90aa-d895b11400e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:54:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ab9bab-3000-4dee-96ae-cb29718c885c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ab9bab-3000-4dee-96ae-cb29718c885c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1041726580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2b32ec-7928-477a-a8e7-ed2ec46511a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2776e5d6a844a8ca8ad93fb04abb628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:54:17Z,use_quota=True,user_id='2a2e209ac04348aeb8907b5ebe66e318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2f6fa8-8715-403b-966a-7c1b797e1400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2f6fa8-8715-403b-966a-7c1b797e1400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616d7518-c7dc-464b-bc74-9b5e1da02b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616d7518-c7dc-464b-bc74-9b5e1da02b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa2b32ec-7928-477a-a8e7-ed2ec46511a8', 'volume_name': 'volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6fc01a-a193-4499-b141-417b90261d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6fc01a-a193-4499-b141-417b90261d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cecd5d52-f421-4be8-8b3f-9e8cad2899c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:17 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Volume fa2b32ec-7928-477a-a8e7-ed2ec46511a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8', 'volume_size': 1} Apr 28 05:54:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:17 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1041726580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2b32ec-7928-477a-a8e7-ed2ec46511a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2776e5d6a844a8ca8ad93fb04abb628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:54:17Z,use_quota=True,user_id='2a2e209ac04348aeb8907b5ebe66e318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:54:17 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Creating volume fa2b32ec-7928-477a-a8e7-ed2ec46511a8 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:54:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:17 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:54:17 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:54:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:17 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:54:17 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:54:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:17 devstack sudo[88089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 1073741824 Apr 28 05:54:17 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:18 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f3eecb7b-78e2-4e68-a6dc-fadc5edeab41 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ad0d4c37-72fe-409a-ad62-e53dabf12015" returned: 0 in 1.201s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:18 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f3eecb7b-78e2-4e68-a6dc-fadc5edeab41 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-quobyte-ad0d4c37-72fe-409a-ad62-e53dabf12015" released by "delete_volume" :: held 2.386s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:54:18 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-f3eecb7b-78e2-4e68-a6dc-fadc5edeab41 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Created reservations ['a71b8ebf-a3cb-4abd-b806-73de10d48896', 'ff3a3a06-41bd-44fb-add4-18a6a0e3d8dc', '062560d6-a38a-4e62-93f5-135fabc5ebac', '1cfa51e2-d635-4d45-ab8f-259d54971ea5'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:54:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f3eecb7b-78e2-4e68-a6dc-fadc5edeab41 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f3eecb7b-78e2-4e68-a6dc-fadc5edeab41 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f3eecb7b-78e2-4e68-a6dc-fadc5edeab41 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:54:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f3eecb7b-78e2-4e68-a6dc-fadc5edeab41 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:54:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f3eecb7b-78e2-4e68-a6dc-fadc5edeab41 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f3eecb7b-78e2-4e68-a6dc-fadc5edeab41 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:18 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:54:18 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:18 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 1073741824" returned: 0 in 1.093s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:18 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 Apr 28 05:54:18 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3d5ace0a-a598-4181-a4fe-d42ad09000cc tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "cinder-c78bf80d-6810-4797-9c77-fd6ac7f687be-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:54:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3d5ace0a-a598-4181-a4fe-d42ad09000cc tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-c78bf80d-6810-4797-9c77-fd6ac7f687be-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:54:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3d5ace0a-a598-4181-a4fe-d42ad09000cc tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "cinder-quobyte-c78bf80d-6810-4797-9c77-fd6ac7f687be" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:54:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3d5ace0a-a598-4181-a4fe-d42ad09000cc tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-quobyte-c78bf80d-6810-4797-9c77-fd6ac7f687be" acquired by "delete_volume" :: waited 0.026s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:54:19 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6ecb82-cac1-411f-8811-ef5233158ec3]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:54:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3d5ace0a-a598-4181-a4fe-d42ad09000cc tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c78bf80d-6810-4797-9c77-fd6ac7f687be {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:19 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f3eecb7b-78e2-4e68-a6dc-fadc5edeab41 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.881s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:19 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-f3eecb7b-78e2-4e68-a6dc-fadc5edeab41 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:54:19 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-f3eecb7b-78e2-4e68-a6dc-fadc5edeab41 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Deleted volume successfully. Apr 28 05:54:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f3eecb7b-78e2-4e68-a6dc-fadc5edeab41 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-ad0d4c37-72fe-409a-ad62-e53dabf12015-delete_volume" released by "delete_volume" :: held 3.719s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:54:19 devstack sudo[88102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c78bf80d-6810-4797-9c77-fd6ac7f687be Apr 28 05:54:19 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:19 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8" returned: 0 in 1.110s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:19 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] <== create_volume: return (2251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:54:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.254s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cecd5d52-f421-4be8-8b3f-9e8cad2899c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4389a01f-83f2-411f-a3a0-3003ccabd033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:19 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Volume volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 (fa2b32ec-7928-477a-a8e7-ed2ec46511a8): created successfully Apr 28 05:54:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4389a01f-83f2-411f-a3a0-3003ccabd033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Flow 'volume_create_manager' (492cb7d9-f7b8-474f-90aa-d895b11400e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:54:20 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-795a85fa-bc21-416b-a927-4b7d10085906 tempest-VolumesActionsTest-996686960 None] Created volume successfully. Apr 28 05:54:20 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3d5ace0a-a598-4181-a4fe-d42ad09000cc tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c78bf80d-6810-4797-9c77-fd6ac7f687be" returned: 0 in 1.150s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3d5ace0a-a598-4181-a4fe-d42ad09000cc tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c78bf80d-6810-4797-9c77-fd6ac7f687be {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:20 devstack sudo[88108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c78bf80d-6810-4797-9c77-fd6ac7f687be Apr 28 05:54:20 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:21 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3d5ace0a-a598-4181-a4fe-d42ad09000cc tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c78bf80d-6810-4797-9c77-fd6ac7f687be" returned: 0 in 0.681s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3d5ace0a-a598-4181-a4fe-d42ad09000cc tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-quobyte-c78bf80d-6810-4797-9c77-fd6ac7f687be" released by "delete_volume" :: held 1.902s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:54:21 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-3d5ace0a-a598-4181-a4fe-d42ad09000cc tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Created reservations ['d5b31585-cf2e-447e-9e23-e2046943ce8b', 'b898e002-7d8a-4c43-8201-d0585f490ce6', 'ee5c0328-5d26-409b-94d1-0fd4755d0a18', 'a9b67e12-9668-439b-8cd8-09a59c81542d'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:54:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3d5ace0a-a598-4181-a4fe-d42ad09000cc tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3d5ace0a-a598-4181-a4fe-d42ad09000cc tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3d5ace0a-a598-4181-a4fe-d42ad09000cc tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:54:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3d5ace0a-a598-4181-a4fe-d42ad09000cc tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:54:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3d5ace0a-a598-4181-a4fe-d42ad09000cc tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3d5ace0a-a598-4181-a4fe-d42ad09000cc tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:21 devstack sudo[88146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:54:21 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ba69ebbb-dece-45f0-afc7-72185705baca tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "cinder-76d5de37-661f-4932-a69c-418a7186aab6-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:54:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ba69ebbb-dece-45f0-afc7-72185705baca tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-76d5de37-661f-4932-a69c-418a7186aab6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:54:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ba69ebbb-dece-45f0-afc7-72185705baca tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "cinder-quobyte-76d5de37-661f-4932-a69c-418a7186aab6" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:54:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ba69ebbb-dece-45f0-afc7-72185705baca tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-quobyte-76d5de37-661f-4932-a69c-418a7186aab6" acquired by "delete_volume" :: waited 0.023s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:54:21 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[058f50d1-900c-4e7c-b86b-05a1556e4c51]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:54:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ba69ebbb-dece-45f0-afc7-72185705baca tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-76d5de37-661f-4932-a69c-418a7186aab6 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:21 devstack sudo[88157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-76d5de37-661f-4932-a69c-418a7186aab6 Apr 28 05:54:21 devstack sudo[88157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:22 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3d5ace0a-a598-4181-a4fe-d42ad09000cc tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.954s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:22 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-3d5ace0a-a598-4181-a4fe-d42ad09000cc tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:54:22 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-3d5ace0a-a598-4181-a4fe-d42ad09000cc tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Deleted volume successfully. Apr 28 05:54:22 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-3d5ace0a-a598-4181-a4fe-d42ad09000cc tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-c78bf80d-6810-4797-9c77-fd6ac7f687be-delete_volume" released by "delete_volume" :: held 3.195s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:54:22 devstack sudo[88157]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ba69ebbb-dece-45f0-afc7-72185705baca tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-76d5de37-661f-4932-a69c-418a7186aab6" returned: 0 in 0.683s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ba69ebbb-dece-45f0-afc7-72185705baca tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-76d5de37-661f-4932-a69c-418a7186aab6 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:22 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-76d5de37-661f-4932-a69c-418a7186aab6 Apr 28 05:54:22 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:22 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ba69ebbb-dece-45f0-afc7-72185705baca tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-76d5de37-661f-4932-a69c-418a7186aab6" returned: 0 in 0.561s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:22 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ba69ebbb-dece-45f0-afc7-72185705baca tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-quobyte-76d5de37-661f-4932-a69c-418a7186aab6" released by "delete_volume" :: held 1.294s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:54:22 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-ba69ebbb-dece-45f0-afc7-72185705baca tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Created reservations ['1b43fa7b-29c5-4a4a-8f7a-e85af8849832', '2f51a24b-5362-4c85-b3ff-3982839d12e9', '4b7d9831-c9e6-4838-9f0e-dccff953f06a', '2dd107c5-feeb-4800-8107-a8ed666c7e5e'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:54:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ba69ebbb-dece-45f0-afc7-72185705baca tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ba69ebbb-dece-45f0-afc7-72185705baca tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:23 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ba69ebbb-dece-45f0-afc7-72185705baca tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:54:23 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ba69ebbb-dece-45f0-afc7-72185705baca tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:54:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ba69ebbb-dece-45f0-afc7-72185705baca tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ba69ebbb-dece-45f0-afc7-72185705baca tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:23 devstack sudo[88197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:54:23 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:23 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ba69ebbb-dece-45f0-afc7-72185705baca tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.799s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:23 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-ba69ebbb-dece-45f0-afc7-72185705baca tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:54:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-28bdca8a-4c3e-4b56-8f95-a549d708ff90 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "cinder-c8b9f46a-cce6-439b-a61c-b7e24181cf73-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:54:23 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-ba69ebbb-dece-45f0-afc7-72185705baca tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Deleted volume successfully. Apr 28 05:54:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-28bdca8a-4c3e-4b56-8f95-a549d708ff90 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-c8b9f46a-cce6-439b-a61c-b7e24181cf73-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:54:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ba69ebbb-dece-45f0-afc7-72185705baca tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-76d5de37-661f-4932-a69c-418a7186aab6-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:54:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-28bdca8a-4c3e-4b56-8f95-a549d708ff90 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "cinder-quobyte-c8b9f46a-cce6-439b-a61c-b7e24181cf73" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:54:24 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-28bdca8a-4c3e-4b56-8f95-a549d708ff90 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-quobyte-c8b9f46a-cce6-439b-a61c-b7e24181cf73" acquired by "delete_volume" :: waited 0.026s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:54:24 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c11323-a00c-4d6f-9d06-5be96c8f7ecc]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:54:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-28bdca8a-4c3e-4b56-8f95-a549d708ff90 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c8b9f46a-cce6-439b-a61c-b7e24181cf73 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:24 devstack sudo[88220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c8b9f46a-cce6-439b-a61c-b7e24181cf73 Apr 28 05:54:24 devstack sudo[88220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:25 devstack sudo[88220]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-28bdca8a-4c3e-4b56-8f95-a549d708ff90 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c8b9f46a-cce6-439b-a61c-b7e24181cf73" returned: 0 in 0.982s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-28bdca8a-4c3e-4b56-8f95-a549d708ff90 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c8b9f46a-cce6-439b-a61c-b7e24181cf73 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:25 devstack sudo[88241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c8b9f46a-cce6-439b-a61c-b7e24181cf73 Apr 28 05:54:25 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:25 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-28bdca8a-4c3e-4b56-8f95-a549d708ff90 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c8b9f46a-cce6-439b-a61c-b7e24181cf73" returned: 0 in 0.767s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-28bdca8a-4c3e-4b56-8f95-a549d708ff90 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-quobyte-c8b9f46a-cce6-439b-a61c-b7e24181cf73" released by "delete_volume" :: held 1.826s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:54:25 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-28bdca8a-4c3e-4b56-8f95-a549d708ff90 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Created reservations ['7fda5a50-6f3b-4819-a28c-fe85a80c9ac0', 'a9d552ea-c7de-4bd9-b746-a613a3ded13e', '4f20cb49-9d59-4018-ad05-515d6199e247', 'b0ae34fc-f1fa-403b-ab5e-9abe9a3e694d'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:54:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-28bdca8a-4c3e-4b56-8f95-a549d708ff90 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-28bdca8a-4c3e-4b56-8f95-a549d708ff90 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-28bdca8a-4c3e-4b56-8f95-a549d708ff90 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:54:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-28bdca8a-4c3e-4b56-8f95-a549d708ff90 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:54:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-28bdca8a-4c3e-4b56-8f95-a549d708ff90 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-28bdca8a-4c3e-4b56-8f95-a549d708ff90 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:26 devstack sudo[88245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:54:26 devstack sudo[88245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-107b3bcc-6eb3-443e-a045-8d2c8314adfe tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "cinder-ccbfcf9e-6b25-459e-87eb-da144aded0ad-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:54:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-107b3bcc-6eb3-443e-a045-8d2c8314adfe tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-ccbfcf9e-6b25-459e-87eb-da144aded0ad-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:54:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-107b3bcc-6eb3-443e-a045-8d2c8314adfe tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "cinder-quobyte-ccbfcf9e-6b25-459e-87eb-da144aded0ad" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:54:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-107b3bcc-6eb3-443e-a045-8d2c8314adfe tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-quobyte-ccbfcf9e-6b25-459e-87eb-da144aded0ad" acquired by "delete_volume" :: waited 0.044s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:54:26 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce19366-9e5d-4d0f-a4ce-39cd85839b09]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:54:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-107b3bcc-6eb3-443e-a045-8d2c8314adfe tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccbfcf9e-6b25-459e-87eb-da144aded0ad {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:26 devstack sudo[88247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccbfcf9e-6b25-459e-87eb-da144aded0ad Apr 28 05:54:26 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6729c625-7242-4f2d-89e4-e4d225205653 tempest-ServerRescueNegativeTestJSON-913272488 None] Acquiring lock "cinder-d5e20da1-f513-404b-856a-1cb1c162d0c9-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:54:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6729c625-7242-4f2d-89e4-e4d225205653 tempest-ServerRescueNegativeTestJSON-913272488 None] Lock "cinder-d5e20da1-f513-404b-856a-1cb1c162d0c9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:54:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6729c625-7242-4f2d-89e4-e4d225205653 tempest-ServerRescueNegativeTestJSON-913272488 None] Acquiring lock "cinder-quobyte-d5e20da1-f513-404b-856a-1cb1c162d0c9" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:54:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6729c625-7242-4f2d-89e4-e4d225205653 tempest-ServerRescueNegativeTestJSON-913272488 None] Lock "cinder-quobyte-d5e20da1-f513-404b-856a-1cb1c162d0c9" acquired by "delete_volume" :: waited 0.032s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:54:27 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81f497d-e3c0-4483-9fa8-911aa091ff87]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:54:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6729c625-7242-4f2d-89e4-e4d225205653 tempest-ServerRescueNegativeTestJSON-913272488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d5e20da1-f513-404b-856a-1cb1c162d0c9 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:27 devstack sudo[88250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d5e20da1-f513-404b-856a-1cb1c162d0c9 Apr 28 05:54:27 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:27 devstack sudo[88245]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-28bdca8a-4c3e-4b56-8f95-a549d708ff90 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 1.542s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:27 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-28bdca8a-4c3e-4b56-8f95-a549d708ff90 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:54:27 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-28bdca8a-4c3e-4b56-8f95-a549d708ff90 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Deleted volume successfully. Apr 28 05:54:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-28bdca8a-4c3e-4b56-8f95-a549d708ff90 tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-c8b9f46a-cce6-439b-a61c-b7e24181cf73-delete_volume" released by "delete_volume" :: held 3.772s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:54:28 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-107b3bcc-6eb3-443e-a045-8d2c8314adfe tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccbfcf9e-6b25-459e-87eb-da144aded0ad" returned: 0 in 1.584s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-107b3bcc-6eb3-443e-a045-8d2c8314adfe tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccbfcf9e-6b25-459e-87eb-da144aded0ad {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:28 devstack sudo[88257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccbfcf9e-6b25-459e-87eb-da144aded0ad Apr 28 05:54:28 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:28 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6729c625-7242-4f2d-89e4-e4d225205653 tempest-ServerRescueNegativeTestJSON-913272488 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d5e20da1-f513-404b-856a-1cb1c162d0c9" returned: 0 in 1.212s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6729c625-7242-4f2d-89e4-e4d225205653 tempest-ServerRescueNegativeTestJSON-913272488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d5e20da1-f513-404b-856a-1cb1c162d0c9 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:28 devstack sudo[88262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d5e20da1-f513-404b-856a-1cb1c162d0c9 Apr 28 05:54:28 devstack sudo[88262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:28 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-107b3bcc-6eb3-443e-a045-8d2c8314adfe tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccbfcf9e-6b25-459e-87eb-da144aded0ad" returned: 0 in 0.929s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:29 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-107b3bcc-6eb3-443e-a045-8d2c8314adfe tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-quobyte-ccbfcf9e-6b25-459e-87eb-da144aded0ad" released by "delete_volume" :: held 2.596s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:54:29 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-107b3bcc-6eb3-443e-a045-8d2c8314adfe tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Created reservations ['ddf957b3-aa2b-4537-9e12-5d67a8ad218a', '718324e0-eedb-41ed-ba6c-6f30f3043bf7', '4cea8741-9dc7-4800-b1e0-9dca6603733b', '69d592d8-bb6a-4319-9d0a-67cb1a4ded14'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:54:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-107b3bcc-6eb3-443e-a045-8d2c8314adfe tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-107b3bcc-6eb3-443e-a045-8d2c8314adfe tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-107b3bcc-6eb3-443e-a045-8d2c8314adfe tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:54:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-107b3bcc-6eb3-443e-a045-8d2c8314adfe tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:54:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-107b3bcc-6eb3-443e-a045-8d2c8314adfe tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-107b3bcc-6eb3-443e-a045-8d2c8314adfe tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:29 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:54:29 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:29 devstack sudo[88262]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6729c625-7242-4f2d-89e4-e4d225205653 tempest-ServerRescueNegativeTestJSON-913272488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d5e20da1-f513-404b-856a-1cb1c162d0c9" returned: 0 in 1.505s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:29 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6729c625-7242-4f2d-89e4-e4d225205653 tempest-ServerRescueNegativeTestJSON-913272488 None] Lock "cinder-quobyte-d5e20da1-f513-404b-856a-1cb1c162d0c9" released by "delete_volume" :: held 2.796s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:54:29 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-6729c625-7242-4f2d-89e4-e4d225205653 tempest-ServerRescueNegativeTestJSON-913272488 None] Created reservations ['98f8ac1c-6cb9-40d8-b234-1575c08005a1', '681dbe89-74d9-49b4-8797-1ba0e6cb99c3', '1d691335-5097-4211-b70c-222177bd46a1', 'd3e417fc-5fc7-404e-9a27-4e74d733a543'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:54:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6729c625-7242-4f2d-89e4-e4d225205653 tempest-ServerRescueNegativeTestJSON-913272488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6729c625-7242-4f2d-89e4-e4d225205653 tempest-ServerRescueNegativeTestJSON-913272488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6729c625-7242-4f2d-89e4-e4d225205653 tempest-ServerRescueNegativeTestJSON-913272488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:54:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6729c625-7242-4f2d-89e4-e4d225205653 tempest-ServerRescueNegativeTestJSON-913272488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:54:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6729c625-7242-4f2d-89e4-e4d225205653 tempest-ServerRescueNegativeTestJSON-913272488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6729c625-7242-4f2d-89e4-e4d225205653 tempest-ServerRescueNegativeTestJSON-913272488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:30 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:54:30 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:30 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-107b3bcc-6eb3-443e-a045-8d2c8314adfe tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 1.009s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:30 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-107b3bcc-6eb3-443e-a045-8d2c8314adfe tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:54:30 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-107b3bcc-6eb3-443e-a045-8d2c8314adfe tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Deleted volume successfully. Apr 28 05:54:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-107b3bcc-6eb3-443e-a045-8d2c8314adfe tempest-CreateVolumesFromSourceVolumeTest-1378316122 None] Lock "cinder-ccbfcf9e-6b25-459e-87eb-da144aded0ad-delete_volume" released by "delete_volume" :: held 4.239s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:54:31 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6729c625-7242-4f2d-89e4-e4d225205653 tempest-ServerRescueNegativeTestJSON-913272488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 1.279s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:31 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-6729c625-7242-4f2d-89e4-e4d225205653 tempest-ServerRescueNegativeTestJSON-913272488 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:54:31 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-6729c625-7242-4f2d-89e4-e4d225205653 tempest-ServerRescueNegativeTestJSON-913272488 None] Deleted volume successfully. Apr 28 05:54:31 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6729c625-7242-4f2d-89e4-e4d225205653 tempest-ServerRescueNegativeTestJSON-913272488 None] Lock "cinder-d5e20da1-f513-404b-856a-1cb1c162d0c9-delete_volume" released by "delete_volume" :: held 4.429s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:54:40 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:SELECT=51,cinder:INSERT=20,cinder:UPDATE=67,cinder:DELETE=10 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:54:41 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:UPDATE=113,cinder:DELETE=7,cinder:SELECT=62,cinder:INSERT=21 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:54:42 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:54:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Flow 'volume_create_manager' (4b92fa42-3658-4f19-b38a-7b177c897bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:54:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3fe416c-9674-4060-ac8a-074ebf7aa19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3fe416c-9674-4060-ac8a-074ebf7aa19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1255329889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=880958b4-3db8-436a-8ac8-dc33ef8d00ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66b5996ac1ca44b6a914833f744f0ec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:54:43Z,use_quota=True,user_id='4044dbc184e44f5bbac1298d0c122ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a8579f3-c56a-416b-8131-d76e75722d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a8579f3-c56a-416b-8131-d76e75722d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2821514-7e62-4b92-9d95-af6539a2f749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2821514-7e62-4b92-9d95-af6539a2f749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '880958b4-3db8-436a-8ac8-dc33ef8d00ce', 'volume_name': 'volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba93864-20e4-433c-b4b5-3f7919c39fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba93864-20e4-433c-b4b5-3f7919c39fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e98217-6050-47af-9057-d77d5472c7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:42 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Volume 880958b4-3db8-436a-8ac8-dc33ef8d00ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce', 'volume_size': 1} Apr 28 05:54:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1255329889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=880958b4-3db8-436a-8ac8-dc33ef8d00ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66b5996ac1ca44b6a914833f744f0ec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:54:43Z,use_quota=True,user_id='4044dbc184e44f5bbac1298d0c122ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:54:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Creating volume 880958b4-3db8-436a-8ac8-dc33ef8d00ce {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:54:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:54:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:54:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:54:42 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:54:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:42 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce 1073741824 Apr 28 05:54:42 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:43 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce 1073741824" returned: 0 in 0.765s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:43 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce Apr 28 05:54:43 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:44 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce" returned: 0 in 0.521s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:54:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e98217-6050-47af-9057-d77d5472c7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1f1215-e25b-4663-8bc5-f39ce976f103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:44 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Volume volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce (880958b4-3db8-436a-8ac8-dc33ef8d00ce): created successfully Apr 28 05:54:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1f1215-e25b-4663-8bc5-f39ce976f103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Flow 'volume_create_manager' (4b92fa42-3658-4f19-b38a-7b177c897bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:54:44 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-60098eaa-9aac-4ecb-94e9-8b3aa7548653 tempest-SnapshotDependencyTests-314837113 None] Created volume successfully. Apr 28 05:54:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-8820a614-7de8-4063-987c-9c789051a7f3 tempest-SnapshotDependencyTests-314837113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-8820a614-7de8-4063-987c-9c789051a7f3 tempest-SnapshotDependencyTests-314837113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:45 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-8820a614-7de8-4063-987c-9c789051a7f3 tempest-SnapshotDependencyTests-314837113 None] Creating offline snapshot 0d3de262-5f9f-4127-982e-28133215d756 of volume 880958b4-3db8-436a-8ac8-dc33ef8d00ce {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:54:45 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[997118b3-d104-4f45-89b5-9a35bbaa5e32]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:54:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-8820a614-7de8-4063-987c-9c789051a7f3 tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:45 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cf00c824-847b-4647-89fe-ced994a00026 tempest-VolumesActionsTest-996686960 None] Acquiring lock "cinder-fa2b32ec-7928-477a-a8e7-ed2ec46511a8" by "attach_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:54:45 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cf00c824-847b-4647-89fe-ced994a00026 tempest-VolumesActionsTest-996686960 None] Lock "cinder-fa2b32ec-7928-477a-a8e7-ed2ec46511a8" acquired by "attach_volume" :: waited 0.020s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:54:45 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce Apr 28 05:54:45 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:45 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-cf00c824-847b-4647-89fe-ced994a00026 tempest-VolumesActionsTest-996686960 None] Attaching volume fa2b32ec-7928-477a-a8e7-ed2ec46511a8 to instance 6ede2044-4c07-4fb1-b087-fc4c27046ee2 at mountpoint /dev/vdb on host None. Apr 28 05:54:45 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-cf00c824-847b-4647-89fe-ced994a00026 tempest-VolumesActionsTest-996686960 None] Attach volume completed successfully. Apr 28 05:54:45 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cf00c824-847b-4647-89fe-ced994a00026 tempest-VolumesActionsTest-996686960 None] Lock "cinder-fa2b32ec-7928-477a-a8e7-ed2ec46511a8" released by "attach_volume" :: held 0.154s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:54:45 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-8820a614-7de8-4063-987c-9c789051a7f3 tempest-SnapshotDependencyTests-314837113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce" returned: 0 in 0.624s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-8820a614-7de8-4063-987c-9c789051a7f3 tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:45 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756 1G Apr 28 05:54:45 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5b5d7c6e-5b68-412d-bfeb-c67d2325e857 tempest-VolumesActionsTest-996686960 None] Acquiring lock "cinder-fa2b32ec-7928-477a-a8e7-ed2ec46511a8-detach_volume" by "detach_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:54:45 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:45 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5b5d7c6e-5b68-412d-bfeb-c67d2325e857 tempest-VolumesActionsTest-996686960 None] Lock "cinder-fa2b32ec-7928-477a-a8e7-ed2ec46511a8-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:54:45 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-5b5d7c6e-5b68-412d-bfeb-c67d2325e857 tempest-VolumesActionsTest-996686960 None] Detaching volume fa2b32ec-7928-477a-a8e7-ed2ec46511a8 from instance 6ede2044-4c07-4fb1-b087-fc4c27046ee2. Apr 28 05:54:45 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-5b5d7c6e-5b68-412d-bfeb-c67d2325e857 tempest-VolumesActionsTest-996686960 None] Detach volume completed successfully. Apr 28 05:54:46 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5b5d7c6e-5b68-412d-bfeb-c67d2325e857 tempest-VolumesActionsTest-996686960 None] Lock "cinder-fa2b32ec-7928-477a-a8e7-ed2ec46511a8-detach_volume" released by "detach_volume" :: held 0.077s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:54:46 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-8820a614-7de8-4063-987c-9c789051a7f3 tempest-SnapshotDependencyTests-314837113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756 1G" returned: 0 in 0.780s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-8820a614-7de8-4063-987c-9c789051a7f3 tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:46 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756 Apr 28 05:54:46 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:47 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-8820a614-7de8-4063-987c-9c789051a7f3 tempest-SnapshotDependencyTests-314837113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756" returned: 0 in 0.710s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:47 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-8820a614-7de8-4063-987c-9c789051a7f3 tempest-SnapshotDependencyTests-314837113 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756 is being set with open permissions: ugo+rw Apr 28 05:54:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-8820a614-7de8-4063-987c-9c789051a7f3 tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:47 devstack sudo[88427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756 Apr 28 05:54:47 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:47 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-8820a614-7de8-4063-987c-9c789051a7f3 tempest-SnapshotDependencyTests-314837113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756" returned: 0 in 0.522s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-8820a614-7de8-4063-987c-9c789051a7f3 tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:47 devstack sudo[88439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.info Apr 28 05:54:47 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:48 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-8820a614-7de8-4063-987c-9c789051a7f3 tempest-SnapshotDependencyTests-314837113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.info" returned: 0 in 0.709s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:48 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-8820a614-7de8-4063-987c-9c789051a7f3 tempest-SnapshotDependencyTests-314837113 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.info is being set with open permissions: ugo+rw Apr 28 05:54:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-8820a614-7de8-4063-987c-9c789051a7f3 tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:48 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.info Apr 28 05:54:48 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:49 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-8820a614-7de8-4063-987c-9c789051a7f3 tempest-SnapshotDependencyTests-314837113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.info" returned: 0 in 0.527s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-8820a614-7de8-4063-987c-9c789051a7f3 tempest-SnapshotDependencyTests-314837113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.977s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:49 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-8820a614-7de8-4063-987c-9c789051a7f3 tempest-SnapshotDependencyTests-314837113 None] Create snapshot completed successfully Apr 28 05:54:49 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:54:49 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Flow 'volume_create_manager' (c5528dc4-f2a2-4b47-9fa9-48c4dae48cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:54:49 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77dc2e3b-cb66-468d-82ec-ffe1b09c8b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:49 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77dc2e3b-cb66-468d-82ec-ffe1b09c8b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66b5996ac1ca44b6a914833f744f0ec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0d3de262-5f9f-4127-982e-28133215d756,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:54:50Z,use_quota=True,user_id='4044dbc184e44f5bbac1298d0c122ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:49 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27e3153-f762-48be-813b-1d593f232834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:49 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27e3153-f762-48be-813b-1d593f232834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:49 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568a9b39-95a2-4142-b9f8-211b7fc1ad12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:49 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568a9b39-95a2-4142-b9f8-211b7fc1ad12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6', 'volume_name': 'volume-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6', 'volume_size': 1, 'snapshot_id': '0d3de262-5f9f-4127-982e-28133215d756'}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:49 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50862f5-f185-4c04-87e3-482d56eaa094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:49 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50862f5-f185-4c04-87e3-482d56eaa094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:49 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d780fdc9-1d0a-4de7-b83d-3d8567cc6c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:49 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Volume 40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6', 'volume_size': 1, 'snapshot_id': '0d3de262-5f9f-4127-982e-28133215d756'} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Acquiring lock "cinder-quobyte-0d3de262-5f9f-4127-982e-28133215d756-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6" by "_create_volume_from_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Lock "cinder-quobyte-0d3de262-5f9f-4127-982e-28133215d756-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Creating volume 40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6 from snapshot 0d3de262-5f9f-4127-982e-28133215d756 {{(pid=81829) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Acquiring lock "cinder-quobyte-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6" by "_copy_volume_from_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Lock "cinder-quobyte-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] snapshot: 0d3de262-5f9f-4127-982e-28133215d756, volume: 40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6, {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dad372-d612-4c2c-8398-4d82c58b5f00]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:50 devstack sudo[88469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756 Apr 28 05:54:50 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:50 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756" returned: 0 in 0.565s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] will copy from snapshot at /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Creating direct copy from snapshot {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cf3b2b-30cb-4138-ac97-b78db5bb0788]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:54:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:50 devstack sudo[88474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce Apr 28 05:54:50 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:51 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce" returned: 0 in 0.639s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:51 devstack cinder-volume[81829]: DEBUG cinder.utils [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Path /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6 not found in is_blk_device check {{(pid=81829) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 05:54:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:51 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6 Apr 28 05:54:51 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:54 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:54:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Flow 'volume_create_manager' (174cc3f0-72e0-44e3-8a58-6d949c5ec3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:54:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7f53f7-8aba-47aa-b962-58f8f3503142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7f53f7-8aba-47aa-b962-58f8f3503142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-283755276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16849c9d-43d9-4977-ba3a-b50229e63230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50220e640c56470fb05aeb8cde40d542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:54:54Z,use_quota=True,user_id='902f4a1c8ad849c589c88f4e57d96dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a74aa9f-7c1e-4c50-a690-9b92230ffbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a74aa9f-7c1e-4c50-a690-9b92230ffbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69eefda1-c836-4fa8-9d6a-7edc6ddfc534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69eefda1-c836-4fa8-9d6a-7edc6ddfc534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16849c9d-43d9-4977-ba3a-b50229e63230', 'volume_name': 'volume-16849c9d-43d9-4977-ba3a-b50229e63230', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f2f75a0-b2e8-44a0-b484-a63f9bf1f5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f2f75a0-b2e8-44a0-b484-a63f9bf1f5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4eb884e-a59f-4565-92c4-dc590c57e450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:54 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Volume 16849c9d-43d9-4977-ba3a-b50229e63230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16849c9d-43d9-4977-ba3a-b50229e63230', 'volume_size': 1} Apr 28 05:54:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:57 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6" returned: 0 in 5.799s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:57 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce3e685-3c56-42a5-ae49-635927ffb773]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:54:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:57 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce Apr 28 05:54:57 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:57 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce" returned: 0 in 0.662s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:57 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Image conversion details: src /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6 {{(pid=81829) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:54:57 devstack cinder-volume[81829]: INFO cinder.image.image_utils [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Converted 1024.00 MB image at 176.56 MB/s Apr 28 05:54:57 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6 is being set with open permissions: ugo+rw Apr 28 05:54:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:57 devstack sudo[88509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6 Apr 28 05:54:57 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:58 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6" returned: 0 in 0.447s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Lock "cinder-quobyte-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6" released by "_copy_volume_from_snapshot" :: held 8.228s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Lock "cinder-quobyte-0d3de262-5f9f-4127-982e-28133215d756-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6" released by "_create_volume_from_snapshot" :: held 8.262s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.285s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.907s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-283755276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16849c9d-43d9-4977-ba3a-b50229e63230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50220e640c56470fb05aeb8cde40d542',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:54:54Z,use_quota=True,user_id='902f4a1c8ad849c589c88f4e57d96dec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Creating volume 16849c9d-43d9-4977-ba3a-b50229e63230 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:54:58 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:58 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230 1073741824 Apr 28 05:54:58 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d780fdc9-1d0a-4de7-b83d-3d8567cc6c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6', 'volume_size': 1, 'snapshot_id': '0d3de262-5f9f-4127-982e-28133215d756'}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41585555-eac2-42bc-83f0-d59d8e381b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:58 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Volume volume-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6 (40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6): created successfully Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41585555-eac2-42bc-83f0-d59d8e381b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Flow 'volume_create_manager' (c5528dc4-f2a2-4b47-9fa9-48c4dae48cff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:54:58 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-a30e9458-d639-4053-aa20-771fcd177e2c tempest-SnapshotDependencyTests-314837113 None] Created volume successfully. Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9eda137c-f3f3-4441-90f2-e79526b12c72 tempest-SnapshotDependencyTests-314837113 None] Acquiring lock "cinder-0d3de262-5f9f-4127-982e-28133215d756-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9eda137c-f3f3-4441-90f2-e79526b12c72 tempest-SnapshotDependencyTests-314837113 None] Lock "cinder-0d3de262-5f9f-4127-982e-28133215d756-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9eda137c-f3f3-4441-90f2-e79526b12c72 tempest-SnapshotDependencyTests-314837113 None] Acquiring lock "cinder-quobyte-880958b4-3db8-436a-8ac8-dc33ef8d00ce" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9eda137c-f3f3-4441-90f2-e79526b12c72 tempest-SnapshotDependencyTests-314837113 None] Lock "cinder-quobyte-880958b4-3db8-436a-8ac8-dc33ef8d00ce" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9eda137c-f3f3-4441-90f2-e79526b12c72 tempest-SnapshotDependencyTests-314837113 None] Acquiring lock "cinder-quobyte-0d3de262-5f9f-4127-982e-28133215d756" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9eda137c-f3f3-4441-90f2-e79526b12c72 tempest-SnapshotDependencyTests-314837113 None] Lock "cinder-quobyte-0d3de262-5f9f-4127-982e-28133215d756" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:54:58 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-9eda137c-f3f3-4441-90f2-e79526b12c72 tempest-SnapshotDependencyTests-314837113 None] Deleting offline snapshot 0d3de262-5f9f-4127-982e-28133215d756 of volume 880958b4-3db8-436a-8ac8-dc33ef8d00ce {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-9eda137c-f3f3-4441-90f2-e79526b12c72 tempest-SnapshotDependencyTests-314837113 None] snapshot_file for this snap is: volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230 1073741824" returned: 0 in 0.667s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66ff065-fe9a-4df7-8763-0ab103015058]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:54:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9eda137c-f3f3-4441-90f2-e79526b12c72 tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:59 devstack sudo[88520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230 Apr 28 05:54:59 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:59 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756 Apr 28 05:54:59 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:59 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230" returned: 0 in 0.484s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:59 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:54:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:54:59 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4eb884e-a59f-4565-92c4-dc590c57e450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16849c9d-43d9-4977-ba3a-b50229e63230', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:59 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead700b7-cfe8-4d15-ba16-d2ec1608abf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:54:59 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Volume volume-16849c9d-43d9-4977-ba3a-b50229e63230 (16849c9d-43d9-4977-ba3a-b50229e63230): created successfully Apr 28 05:54:59 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead700b7-cfe8-4d15-ba16-d2ec1608abf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:54:59 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Apr 28 05:54:59 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Flow 'volume_create_manager' (174cc3f0-72e0-44e3-8a58-6d949c5ec3cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:54:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9eda137c-f3f3-4441-90f2-e79526b12c72 tempest-SnapshotDependencyTests-314837113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756" returned: 0 in 0.571s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:54:59 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-9eda137c-f3f3-4441-90f2-e79526b12c72 tempest-SnapshotDependencyTests-314837113 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:54:59 devstack cinder-volume[81829]: INFO cinder.volume.manager [req-e9c7021a-d9cb-45d0-a992-3df7494cd168 req-bb95a4d0-c936-4b00-ad61-da6dd9156abf tempest-VolumesSnapshotsTestJSON-769507826 None] Created volume successfully. Apr 28 05:54:59 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2c1d18-43b0-4a6a-8af2-3c62361378c7]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:54:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9eda137c-f3f3-4441-90f2-e79526b12c72 tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:54:59 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce Apr 28 05:54:59 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:54:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-5a6799e7-57bb-41ca-bf60-8767c6ac07b6 req-674a1cad-c6eb-4aae-b268-00fe60187318 tempest-VolumesSnapshotsTestJSON-769507826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:54:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-5a6799e7-57bb-41ca-bf60-8767c6ac07b6 req-674a1cad-c6eb-4aae-b268-00fe60187318 tempest-VolumesSnapshotsTestJSON-769507826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:54:59 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [req-5a6799e7-57bb-41ca-bf60-8767c6ac07b6 req-674a1cad-c6eb-4aae-b268-00fe60187318 tempest-VolumesSnapshotsTestJSON-769507826 None] Creating offline snapshot b4acc9c2-779d-4819-a72a-1f159f509a98 of volume 16849c9d-43d9-4977-ba3a-b50229e63230 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:54:59 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[6406f8c8-8a8d-4ae9-90f7-36fa9c67cfd6]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:54:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-5a6799e7-57bb-41ca-bf60-8767c6ac07b6 req-674a1cad-c6eb-4aae-b268-00fe60187318 tempest-VolumesSnapshotsTestJSON-769507826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:00 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230 Apr 28 05:55:00 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:00 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9eda137c-f3f3-4441-90f2-e79526b12c72 tempest-SnapshotDependencyTests-314837113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce" returned: 0 in 0.619s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9eda137c-f3f3-4441-90f2-e79526b12c72 tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:00 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756 Apr 28 05:55:00 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:00 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-5a6799e7-57bb-41ca-bf60-8767c6ac07b6 req-674a1cad-c6eb-4aae-b268-00fe60187318 tempest-VolumesSnapshotsTestJSON-769507826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230" returned: 0 in 0.606s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-5a6799e7-57bb-41ca-bf60-8767c6ac07b6 req-674a1cad-c6eb-4aae-b268-00fe60187318 tempest-VolumesSnapshotsTestJSON-769507826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.b4acc9c2-779d-4819-a72a-1f159f509a98 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:00 devstack sudo[88539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.b4acc9c2-779d-4819-a72a-1f159f509a98 1G Apr 28 05:55:00 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:00 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9eda137c-f3f3-4441-90f2-e79526b12c72 tempest-SnapshotDependencyTests-314837113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756" returned: 0 in 0.571s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9eda137c-f3f3-4441-90f2-e79526b12c72 tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:00 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756 Apr 28 05:55:00 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:01 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-5a6799e7-57bb-41ca-bf60-8767c6ac07b6 req-674a1cad-c6eb-4aae-b268-00fe60187318 tempest-VolumesSnapshotsTestJSON-769507826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.b4acc9c2-779d-4819-a72a-1f159f509a98 1G" returned: 0 in 0.634s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-5a6799e7-57bb-41ca-bf60-8767c6ac07b6 req-674a1cad-c6eb-4aae-b268-00fe60187318 tempest-VolumesSnapshotsTestJSON-769507826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16849c9d-43d9-4977-ba3a-b50229e63230 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.b4acc9c2-779d-4819-a72a-1f159f509a98 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:01 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16849c9d-43d9-4977-ba3a-b50229e63230 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.b4acc9c2-779d-4819-a72a-1f159f509a98 Apr 28 05:55:01 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:01 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9eda137c-f3f3-4441-90f2-e79526b12c72 tempest-SnapshotDependencyTests-314837113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce.0d3de262-5f9f-4127-982e-28133215d756" returned: 0 in 0.464s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9eda137c-f3f3-4441-90f2-e79526b12c72 tempest-SnapshotDependencyTests-314837113 None] Lock "cinder-quobyte-0d3de262-5f9f-4127-982e-28133215d756" released by "_delete_snapshot" :: held 2.338s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:55:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9eda137c-f3f3-4441-90f2-e79526b12c72 tempest-SnapshotDependencyTests-314837113 None] Lock "cinder-quobyte-880958b4-3db8-436a-8ac8-dc33ef8d00ce" released by "delete_snapshot" :: held 2.363s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:55:01 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-9eda137c-f3f3-4441-90f2-e79526b12c72 tempest-SnapshotDependencyTests-314837113 None] Created reservations ['8e4b799b-ea2d-4094-872f-120c1e1aaee5', '3619942e-3e50-4b3c-a516-dfb6ed30f690', 'd1a2b824-4fe4-412f-8c3b-5ba7bbe32590', '721b469b-96ba-4a6e-8064-efc4b34bdee7'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:55:01 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-9eda137c-f3f3-4441-90f2-e79526b12c72 tempest-SnapshotDependencyTests-314837113 None] Delete snapshot completed successfully. Apr 28 05:55:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9eda137c-f3f3-4441-90f2-e79526b12c72 tempest-SnapshotDependencyTests-314837113 None] Lock "cinder-0d3de262-5f9f-4127-982e-28133215d756-delete_snapshot" released by "delete_snapshot" :: held 2.497s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:55:01 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-5a6799e7-57bb-41ca-bf60-8767c6ac07b6 req-674a1cad-c6eb-4aae-b268-00fe60187318 tempest-VolumesSnapshotsTestJSON-769507826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16849c9d-43d9-4977-ba3a-b50229e63230 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.b4acc9c2-779d-4819-a72a-1f159f509a98" returned: 0 in 0.516s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:01 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [req-5a6799e7-57bb-41ca-bf60-8767c6ac07b6 req-674a1cad-c6eb-4aae-b268-00fe60187318 tempest-VolumesSnapshotsTestJSON-769507826 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.b4acc9c2-779d-4819-a72a-1f159f509a98 is being set with open permissions: ugo+rw Apr 28 05:55:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-5a6799e7-57bb-41ca-bf60-8767c6ac07b6 req-674a1cad-c6eb-4aae-b268-00fe60187318 tempest-VolumesSnapshotsTestJSON-769507826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.b4acc9c2-779d-4819-a72a-1f159f509a98 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:01 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.b4acc9c2-779d-4819-a72a-1f159f509a98 Apr 28 05:55:01 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:02 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-840d5c66-1fd6-4993-bbc2-786d543d0093 tempest-SnapshotDependencyTests-314837113 None] Acquiring lock "cinder-880958b4-3db8-436a-8ac8-dc33ef8d00ce-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:55:02 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-840d5c66-1fd6-4993-bbc2-786d543d0093 tempest-SnapshotDependencyTests-314837113 None] Lock "cinder-880958b4-3db8-436a-8ac8-dc33ef8d00ce-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:55:02 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:02 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-840d5c66-1fd6-4993-bbc2-786d543d0093 tempest-SnapshotDependencyTests-314837113 None] Acquiring lock "cinder-quobyte-880958b4-3db8-436a-8ac8-dc33ef8d00ce" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:55:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-5a6799e7-57bb-41ca-bf60-8767c6ac07b6 req-674a1cad-c6eb-4aae-b268-00fe60187318 tempest-VolumesSnapshotsTestJSON-769507826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.b4acc9c2-779d-4819-a72a-1f159f509a98" returned: 0 in 0.553s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:02 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-840d5c66-1fd6-4993-bbc2-786d543d0093 tempest-SnapshotDependencyTests-314837113 None] Lock "cinder-quobyte-880958b4-3db8-436a-8ac8-dc33ef8d00ce" acquired by "delete_volume" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:55:02 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a892d36-e787-479e-82d5-fc5f4d499ca0]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:55:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-840d5c66-1fd6-4993-bbc2-786d543d0093 tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-5a6799e7-57bb-41ca-bf60-8767c6ac07b6 req-674a1cad-c6eb-4aae-b268-00fe60187318 tempest-VolumesSnapshotsTestJSON-769507826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:02 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.info Apr 28 05:55:02 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:02 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce Apr 28 05:55:02 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:02 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-5a6799e7-57bb-41ca-bf60-8767c6ac07b6 req-674a1cad-c6eb-4aae-b268-00fe60187318 tempest-VolumesSnapshotsTestJSON-769507826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.info" returned: 0 in 0.591s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:02 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [req-5a6799e7-57bb-41ca-bf60-8767c6ac07b6 req-674a1cad-c6eb-4aae-b268-00fe60187318 tempest-VolumesSnapshotsTestJSON-769507826 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.info is being set with open permissions: ugo+rw Apr 28 05:55:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-5a6799e7-57bb-41ca-bf60-8767c6ac07b6 req-674a1cad-c6eb-4aae-b268-00fe60187318 tempest-VolumesSnapshotsTestJSON-769507826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:02 devstack sudo[88567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.info Apr 28 05:55:02 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:02 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-840d5c66-1fd6-4993-bbc2-786d543d0093 tempest-SnapshotDependencyTests-314837113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce" returned: 0 in 0.661s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-840d5c66-1fd6-4993-bbc2-786d543d0093 tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:03 devstack sudo[88569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce Apr 28 05:55:03 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:03 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-5a6799e7-57bb-41ca-bf60-8767c6ac07b6 req-674a1cad-c6eb-4aae-b268-00fe60187318 tempest-VolumesSnapshotsTestJSON-769507826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.info" returned: 0 in 0.556s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-5a6799e7-57bb-41ca-bf60-8767c6ac07b6 req-674a1cad-c6eb-4aae-b268-00fe60187318 tempest-VolumesSnapshotsTestJSON-769507826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.634s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:55:03 devstack cinder-volume[81829]: INFO cinder.volume.manager [req-5a6799e7-57bb-41ca-bf60-8767c6ac07b6 req-674a1cad-c6eb-4aae-b268-00fe60187318 tempest-VolumesSnapshotsTestJSON-769507826 None] Create snapshot completed successfully Apr 28 05:55:03 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-840d5c66-1fd6-4993-bbc2-786d543d0093 tempest-SnapshotDependencyTests-314837113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-880958b4-3db8-436a-8ac8-dc33ef8d00ce" returned: 0 in 0.591s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:03 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-840d5c66-1fd6-4993-bbc2-786d543d0093 tempest-SnapshotDependencyTests-314837113 None] Lock "cinder-quobyte-880958b4-3db8-436a-8ac8-dc33ef8d00ce" released by "delete_volume" :: held 1.362s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:55:03 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-840d5c66-1fd6-4993-bbc2-786d543d0093 tempest-SnapshotDependencyTests-314837113 None] Created reservations ['eaf8cf4d-f8dc-4930-bc1a-3c1cf0d5284d', '3da61302-1d17-4630-ac98-bd49267f8876', '73b0e109-aac5-4e53-89fd-863224a19760', 'b87105bf-5ade-4cd8-a3f0-a35200443d11'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:55:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-840d5c66-1fd6-4993-bbc2-786d543d0093 tempest-SnapshotDependencyTests-314837113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:55:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-840d5c66-1fd6-4993-bbc2-786d543d0093 tempest-SnapshotDependencyTests-314837113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:55:03 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-840d5c66-1fd6-4993-bbc2-786d543d0093 tempest-SnapshotDependencyTests-314837113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:55:03 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-840d5c66-1fd6-4993-bbc2-786d543d0093 tempest-SnapshotDependencyTests-314837113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:55:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-840d5c66-1fd6-4993-bbc2-786d543d0093 tempest-SnapshotDependencyTests-314837113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:55:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-840d5c66-1fd6-4993-bbc2-786d543d0093 tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:03 devstack sudo[88575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:55:03 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:04 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-840d5c66-1fd6-4993-bbc2-786d543d0093 tempest-SnapshotDependencyTests-314837113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.501s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:04 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-840d5c66-1fd6-4993-bbc2-786d543d0093 tempest-SnapshotDependencyTests-314837113 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:55:04 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-840d5c66-1fd6-4993-bbc2-786d543d0093 tempest-SnapshotDependencyTests-314837113 None] Deleted volume successfully. Apr 28 05:55:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-840d5c66-1fd6-4993-bbc2-786d543d0093 tempest-SnapshotDependencyTests-314837113 None] Lock "cinder-880958b4-3db8-436a-8ac8-dc33ef8d00ce-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:55:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7ec2d5e5-ec89-4e01-a5ba-02dbf46d086f tempest-SnapshotDependencyTests-314837113 None] Acquiring lock "cinder-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:55:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7ec2d5e5-ec89-4e01-a5ba-02dbf46d086f tempest-SnapshotDependencyTests-314837113 None] Lock "cinder-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:55:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-9f4cd5cd-1166-4804-a1a2-a5a8559650cd req-d9cb4a4a-de43-45d7-a929-8e7c38b99a59 tempest-VolumesSnapshotsTestJSON-769507826 None] Acquiring lock "cinder-b4acc9c2-779d-4819-a72a-1f159f509a98-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:55:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7ec2d5e5-ec89-4e01-a5ba-02dbf46d086f tempest-SnapshotDependencyTests-314837113 None] Acquiring lock "cinder-quobyte-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:55:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-9f4cd5cd-1166-4804-a1a2-a5a8559650cd req-d9cb4a4a-de43-45d7-a929-8e7c38b99a59 tempest-VolumesSnapshotsTestJSON-769507826 None] Lock "cinder-b4acc9c2-779d-4819-a72a-1f159f509a98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:55:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-9f4cd5cd-1166-4804-a1a2-a5a8559650cd req-d9cb4a4a-de43-45d7-a929-8e7c38b99a59 tempest-VolumesSnapshotsTestJSON-769507826 None] Acquiring lock "cinder-quobyte-16849c9d-43d9-4977-ba3a-b50229e63230" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:55:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7ec2d5e5-ec89-4e01-a5ba-02dbf46d086f tempest-SnapshotDependencyTests-314837113 None] Lock "cinder-quobyte-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6" acquired by "delete_volume" :: waited 0.031s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:55:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-9f4cd5cd-1166-4804-a1a2-a5a8559650cd req-d9cb4a4a-de43-45d7-a929-8e7c38b99a59 tempest-VolumesSnapshotsTestJSON-769507826 None] Lock "cinder-quobyte-16849c9d-43d9-4977-ba3a-b50229e63230" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:55:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-9f4cd5cd-1166-4804-a1a2-a5a8559650cd req-d9cb4a4a-de43-45d7-a929-8e7c38b99a59 tempest-VolumesSnapshotsTestJSON-769507826 None] Acquiring lock "cinder-quobyte-b4acc9c2-779d-4819-a72a-1f159f509a98" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:55:04 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[452d6e53-4004-4b02-9f9e-d94a191351d7]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:55:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7ec2d5e5-ec89-4e01-a5ba-02dbf46d086f tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-9f4cd5cd-1166-4804-a1a2-a5a8559650cd req-d9cb4a4a-de43-45d7-a929-8e7c38b99a59 tempest-VolumesSnapshotsTestJSON-769507826 None] Lock "cinder-quobyte-b4acc9c2-779d-4819-a72a-1f159f509a98" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:55:04 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [req-9f4cd5cd-1166-4804-a1a2-a5a8559650cd req-d9cb4a4a-de43-45d7-a929-8e7c38b99a59 tempest-VolumesSnapshotsTestJSON-769507826 None] Deleting offline snapshot b4acc9c2-779d-4819-a72a-1f159f509a98 of volume 16849c9d-43d9-4977-ba3a-b50229e63230 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:55:04 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [req-9f4cd5cd-1166-4804-a1a2-a5a8559650cd req-d9cb4a4a-de43-45d7-a929-8e7c38b99a59 tempest-VolumesSnapshotsTestJSON-769507826 None] snapshot_file for this snap is: volume-16849c9d-43d9-4977-ba3a-b50229e63230.b4acc9c2-779d-4819-a72a-1f159f509a98 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:55:04 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf181868-d627-477a-a159-b785ce69adfb]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:55:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-9f4cd5cd-1166-4804-a1a2-a5a8559650cd req-d9cb4a4a-de43-45d7-a929-8e7c38b99a59 tempest-VolumesSnapshotsTestJSON-769507826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.b4acc9c2-779d-4819-a72a-1f159f509a98 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:04 devstack sudo[88592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6 Apr 28 05:55:04 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:04 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.b4acc9c2-779d-4819-a72a-1f159f509a98 Apr 28 05:55:04 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:05 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7ec2d5e5-ec89-4e01-a5ba-02dbf46d086f tempest-SnapshotDependencyTests-314837113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6" returned: 0 in 0.537s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7ec2d5e5-ec89-4e01-a5ba-02dbf46d086f tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:05 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6 Apr 28 05:55:05 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:05 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-9f4cd5cd-1166-4804-a1a2-a5a8559650cd req-d9cb4a4a-de43-45d7-a929-8e7c38b99a59 tempest-VolumesSnapshotsTestJSON-769507826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.b4acc9c2-779d-4819-a72a-1f159f509a98" returned: 0 in 0.595s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [req-9f4cd5cd-1166-4804-a1a2-a5a8559650cd req-d9cb4a4a-de43-45d7-a929-8e7c38b99a59 tempest-VolumesSnapshotsTestJSON-769507826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16849c9d-43d9-4977-ba3a-b50229e63230(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:55:05 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[02993b44-fc68-4a0b-adff-1ff4276175a5]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:55:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-9f4cd5cd-1166-4804-a1a2-a5a8559650cd req-d9cb4a4a-de43-45d7-a929-8e7c38b99a59 tempest-VolumesSnapshotsTestJSON-769507826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:05 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230 Apr 28 05:55:05 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:05 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7ec2d5e5-ec89-4e01-a5ba-02dbf46d086f tempest-SnapshotDependencyTests-314837113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6" returned: 0 in 0.566s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7ec2d5e5-ec89-4e01-a5ba-02dbf46d086f tempest-SnapshotDependencyTests-314837113 None] Lock "cinder-quobyte-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6" released by "delete_volume" :: held 1.150s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:55:05 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-7ec2d5e5-ec89-4e01-a5ba-02dbf46d086f tempest-SnapshotDependencyTests-314837113 None] Created reservations ['debc4377-2e95-4e6d-8aaf-afdf9ef7eaa5', 'f93f9327-1c40-49f7-8407-e55a0052262f', '3090fb24-14ab-455a-be07-21db8b2043d9', '7dd8416c-3d57-4642-96ef-c4e891d0d3d6'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:55:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7ec2d5e5-ec89-4e01-a5ba-02dbf46d086f tempest-SnapshotDependencyTests-314837113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:55:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7ec2d5e5-ec89-4e01-a5ba-02dbf46d086f tempest-SnapshotDependencyTests-314837113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:55:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7ec2d5e5-ec89-4e01-a5ba-02dbf46d086f tempest-SnapshotDependencyTests-314837113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:55:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7ec2d5e5-ec89-4e01-a5ba-02dbf46d086f tempest-SnapshotDependencyTests-314837113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:55:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7ec2d5e5-ec89-4e01-a5ba-02dbf46d086f tempest-SnapshotDependencyTests-314837113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:55:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7ec2d5e5-ec89-4e01-a5ba-02dbf46d086f tempest-SnapshotDependencyTests-314837113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:05 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-9f4cd5cd-1166-4804-a1a2-a5a8559650cd req-d9cb4a4a-de43-45d7-a929-8e7c38b99a59 tempest-VolumesSnapshotsTestJSON-769507826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230" returned: 0 in 0.557s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-9f4cd5cd-1166-4804-a1a2-a5a8559650cd req-d9cb4a4a-de43-45d7-a929-8e7c38b99a59 tempest-VolumesSnapshotsTestJSON-769507826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.b4acc9c2-779d-4819-a72a-1f159f509a98 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:05 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:55:05 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:05 devstack sudo[88611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.b4acc9c2-779d-4819-a72a-1f159f509a98 Apr 28 05:55:05 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:06 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7ec2d5e5-ec89-4e01-a5ba-02dbf46d086f tempest-SnapshotDependencyTests-314837113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.454s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:06 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-7ec2d5e5-ec89-4e01-a5ba-02dbf46d086f tempest-SnapshotDependencyTests-314837113 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:55:06 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-7ec2d5e5-ec89-4e01-a5ba-02dbf46d086f tempest-SnapshotDependencyTests-314837113 None] Deleted volume successfully. Apr 28 05:55:06 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7ec2d5e5-ec89-4e01-a5ba-02dbf46d086f tempest-SnapshotDependencyTests-314837113 None] Lock "cinder-40e2135e-4a9c-4ce4-8ad6-cfcc6b3bf3c6-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:55:06 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-9f4cd5cd-1166-4804-a1a2-a5a8559650cd req-d9cb4a4a-de43-45d7-a929-8e7c38b99a59 tempest-VolumesSnapshotsTestJSON-769507826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.b4acc9c2-779d-4819-a72a-1f159f509a98" returned: 0 in 0.612s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-9f4cd5cd-1166-4804-a1a2-a5a8559650cd req-d9cb4a4a-de43-45d7-a929-8e7c38b99a59 tempest-VolumesSnapshotsTestJSON-769507826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.b4acc9c2-779d-4819-a72a-1f159f509a98 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:06 devstack sudo[88618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.b4acc9c2-779d-4819-a72a-1f159f509a98 Apr 28 05:55:06 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:06 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-9f4cd5cd-1166-4804-a1a2-a5a8559650cd req-d9cb4a4a-de43-45d7-a929-8e7c38b99a59 tempest-VolumesSnapshotsTestJSON-769507826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230.b4acc9c2-779d-4819-a72a-1f159f509a98" returned: 0 in 0.479s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:06 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-9f4cd5cd-1166-4804-a1a2-a5a8559650cd req-d9cb4a4a-de43-45d7-a929-8e7c38b99a59 tempest-VolumesSnapshotsTestJSON-769507826 None] Lock "cinder-quobyte-b4acc9c2-779d-4819-a72a-1f159f509a98" released by "_delete_snapshot" :: held 2.385s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:55:06 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-9f4cd5cd-1166-4804-a1a2-a5a8559650cd req-d9cb4a4a-de43-45d7-a929-8e7c38b99a59 tempest-VolumesSnapshotsTestJSON-769507826 None] Lock "cinder-quobyte-16849c9d-43d9-4977-ba3a-b50229e63230" released by "delete_snapshot" :: held 2.423s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:55:06 devstack cinder-volume[81829]: DEBUG oslo_service.periodic_task [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81829) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 05:55:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:55:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:55:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:55:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:55:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:55:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:06 devstack sudo[88624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:55:06 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:06 devstack cinder-volume[81829]: DEBUG cinder.quota [req-9f4cd5cd-1166-4804-a1a2-a5a8559650cd req-d9cb4a4a-de43-45d7-a929-8e7c38b99a59 tempest-VolumesSnapshotsTestJSON-769507826 None] Created reservations ['766ef0ec-c621-4b72-bc78-1c73c57be03e', 'dedb1482-b815-4d7e-8711-54bea908424e', '78050d8c-62a9-40c6-a8e7-c3cccf6e9d9e', '4b5a266c-987a-474c-af45-39ab23f97fc9'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:55:07 devstack cinder-volume[81829]: INFO cinder.volume.manager [req-9f4cd5cd-1166-4804-a1a2-a5a8559650cd req-d9cb4a4a-de43-45d7-a929-8e7c38b99a59 tempest-VolumesSnapshotsTestJSON-769507826 None] Delete snapshot completed successfully. Apr 28 05:55:07 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-9f4cd5cd-1166-4804-a1a2-a5a8559650cd req-d9cb4a4a-de43-45d7-a929-8e7c38b99a59 tempest-VolumesSnapshotsTestJSON-769507826 None] Lock "cinder-b4acc9c2-779d-4819-a72a-1f159f509a98-delete_snapshot" released by "delete_snapshot" :: held 2.605s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:55:07 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.497s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:07 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:55:07 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-2e2fb412-0b89-49b0-9466-967ae7caa558 req-5531bfd6-e248-42cb-868d-a2be7bee3251 tempest-VolumesSnapshotsTestJSON-769507826 None] Acquiring lock "cinder-16849c9d-43d9-4977-ba3a-b50229e63230-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:55:07 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-2e2fb412-0b89-49b0-9466-967ae7caa558 req-5531bfd6-e248-42cb-868d-a2be7bee3251 tempest-VolumesSnapshotsTestJSON-769507826 None] Lock "cinder-16849c9d-43d9-4977-ba3a-b50229e63230-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:55:07 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-2e2fb412-0b89-49b0-9466-967ae7caa558 req-5531bfd6-e248-42cb-868d-a2be7bee3251 tempest-VolumesSnapshotsTestJSON-769507826 None] Acquiring lock "cinder-quobyte-16849c9d-43d9-4977-ba3a-b50229e63230" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:55:07 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-2e2fb412-0b89-49b0-9466-967ae7caa558 req-5531bfd6-e248-42cb-868d-a2be7bee3251 tempest-VolumesSnapshotsTestJSON-769507826 None] Lock "cinder-quobyte-16849c9d-43d9-4977-ba3a-b50229e63230" acquired by "delete_volume" :: waited 0.019s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:55:07 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[41131e3a-f63b-43d7-a963-33ad49368eb8]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:55:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2e2fb412-0b89-49b0-9466-967ae7caa558 req-5531bfd6-e248-42cb-868d-a2be7bee3251 tempest-VolumesSnapshotsTestJSON-769507826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:07 devstack sudo[88627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230 Apr 28 05:55:07 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:08 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2e2fb412-0b89-49b0-9466-967ae7caa558 req-5531bfd6-e248-42cb-868d-a2be7bee3251 tempest-VolumesSnapshotsTestJSON-769507826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230" returned: 0 in 0.624s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2e2fb412-0b89-49b0-9466-967ae7caa558 req-5531bfd6-e248-42cb-868d-a2be7bee3251 tempest-VolumesSnapshotsTestJSON-769507826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:08 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230 Apr 28 05:55:08 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:09 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2e2fb412-0b89-49b0-9466-967ae7caa558 req-5531bfd6-e248-42cb-868d-a2be7bee3251 tempest-VolumesSnapshotsTestJSON-769507826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-16849c9d-43d9-4977-ba3a-b50229e63230" returned: 0 in 0.577s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:09 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-2e2fb412-0b89-49b0-9466-967ae7caa558 req-5531bfd6-e248-42cb-868d-a2be7bee3251 tempest-VolumesSnapshotsTestJSON-769507826 None] Lock "cinder-quobyte-16849c9d-43d9-4977-ba3a-b50229e63230" released by "delete_volume" :: held 1.283s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:55:09 devstack cinder-volume[81829]: DEBUG cinder.quota [req-2e2fb412-0b89-49b0-9466-967ae7caa558 req-5531bfd6-e248-42cb-868d-a2be7bee3251 tempest-VolumesSnapshotsTestJSON-769507826 None] Created reservations ['02ceaae4-618e-49d7-9096-345155ade690', '35541a2e-a888-43e4-9653-2b69469e77ce', '6fbaf7bf-1a7a-4b52-8a0f-93d1d4e297b0', '0ee3283d-3ef8-447b-8ec6-df5d6c2bc337'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:55:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-2e2fb412-0b89-49b0-9466-967ae7caa558 req-5531bfd6-e248-42cb-868d-a2be7bee3251 tempest-VolumesSnapshotsTestJSON-769507826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:55:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-2e2fb412-0b89-49b0-9466-967ae7caa558 req-5531bfd6-e248-42cb-868d-a2be7bee3251 tempest-VolumesSnapshotsTestJSON-769507826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:55:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-2e2fb412-0b89-49b0-9466-967ae7caa558 req-5531bfd6-e248-42cb-868d-a2be7bee3251 tempest-VolumesSnapshotsTestJSON-769507826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:55:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [req-2e2fb412-0b89-49b0-9466-967ae7caa558 req-5531bfd6-e248-42cb-868d-a2be7bee3251 tempest-VolumesSnapshotsTestJSON-769507826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:55:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [req-2e2fb412-0b89-49b0-9466-967ae7caa558 req-5531bfd6-e248-42cb-868d-a2be7bee3251 tempest-VolumesSnapshotsTestJSON-769507826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:55:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2e2fb412-0b89-49b0-9466-967ae7caa558 req-5531bfd6-e248-42cb-868d-a2be7bee3251 tempest-VolumesSnapshotsTestJSON-769507826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:09 devstack sudo[88789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:55:09 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:09 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [req-2e2fb412-0b89-49b0-9466-967ae7caa558 req-5531bfd6-e248-42cb-868d-a2be7bee3251 tempest-VolumesSnapshotsTestJSON-769507826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.541s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:09 devstack cinder-volume[81829]: DEBUG cinder.manager [req-2e2fb412-0b89-49b0-9466-967ae7caa558 req-5531bfd6-e248-42cb-868d-a2be7bee3251 tempest-VolumesSnapshotsTestJSON-769507826 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:55:09 devstack cinder-volume[81829]: INFO cinder.volume.manager [req-2e2fb412-0b89-49b0-9466-967ae7caa558 req-5531bfd6-e248-42cb-868d-a2be7bee3251 tempest-VolumesSnapshotsTestJSON-769507826 None] Deleted volume successfully. Apr 28 05:55:09 devstack cinder-volume[81829]: DEBUG cinder.coordination [req-2e2fb412-0b89-49b0-9466-967ae7caa558 req-5531bfd6-e248-42cb-868d-a2be7bee3251 tempest-VolumesSnapshotsTestJSON-769507826 None] Lock "cinder-16849c9d-43d9-4977-ba3a-b50229e63230-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:55:14 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e3508525-00f9-401b-ad13-b1ae77088eb8 tempest-VolumesActionsTest-996686960 None] Acquiring lock "cinder-fa2b32ec-7928-477a-a8e7-ed2ec46511a8" by "attach_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:55:14 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e3508525-00f9-401b-ad13-b1ae77088eb8 tempest-VolumesActionsTest-996686960 None] Lock "cinder-fa2b32ec-7928-477a-a8e7-ed2ec46511a8" acquired by "attach_volume" :: waited 0.039s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:55:14 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-e3508525-00f9-401b-ad13-b1ae77088eb8 tempest-VolumesActionsTest-996686960 None] Attaching volume fa2b32ec-7928-477a-a8e7-ed2ec46511a8 to instance 13ff8776-adda-4b8f-adcf-0956abcbeea1 at mountpoint /dev/vdb on host None. Apr 28 05:55:14 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-e3508525-00f9-401b-ad13-b1ae77088eb8 tempest-VolumesActionsTest-996686960 None] Attach volume completed successfully. Apr 28 05:55:14 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e3508525-00f9-401b-ad13-b1ae77088eb8 tempest-VolumesActionsTest-996686960 None] Lock "cinder-fa2b32ec-7928-477a-a8e7-ed2ec46511a8" released by "attach_volume" :: held 0.109s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:55:14 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2427ab96-8e48-49ba-8c1f-2e06cd83c32f tempest-VolumesActionsTest-996686960 None] Acquiring lock "cinder-fa2b32ec-7928-477a-a8e7-ed2ec46511a8-detach_volume" by "detach_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:55:14 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2427ab96-8e48-49ba-8c1f-2e06cd83c32f tempest-VolumesActionsTest-996686960 None] Lock "cinder-fa2b32ec-7928-477a-a8e7-ed2ec46511a8-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:55:14 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-2427ab96-8e48-49ba-8c1f-2e06cd83c32f tempest-VolumesActionsTest-996686960 None] Detaching volume fa2b32ec-7928-477a-a8e7-ed2ec46511a8 from instance 13ff8776-adda-4b8f-adcf-0956abcbeea1. Apr 28 05:55:14 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-2427ab96-8e48-49ba-8c1f-2e06cd83c32f tempest-VolumesActionsTest-996686960 None] Detach volume completed successfully. Apr 28 05:55:14 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2427ab96-8e48-49ba-8c1f-2e06cd83c32f tempest-VolumesActionsTest-996686960 None] Lock "cinder-fa2b32ec-7928-477a-a8e7-ed2ec46511a8-detach_volume" released by "detach_volume" :: held 0.064s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:55:20 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:55:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Flow 'volume_create_manager' (1c82218a-1a1c-48b8-908b-ef5d4802ae54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:55:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a935bad6-7d3a-4766-9043-eabb4da1d5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:55:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a935bad6-7d3a-4766-9043-eabb4da1d5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-287267020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea75e7d-6c2b-454d-9187-f4559ef4e331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c350d07922468889698bda930ac392',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:55:21Z,use_quota=True,user_id='d95e8e0e1abd4c4db001e8a89cb1a5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:55:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22822062-1edd-45cf-9460-b675e7e26afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:55:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22822062-1edd-45cf-9460-b675e7e26afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:55:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (216876cd-1be6-4474-84fb-837158873ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:55:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (216876cd-1be6-4474-84fb-837158873ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cea75e7d-6c2b-454d-9187-f4559ef4e331', 'volume_name': 'volume-cea75e7d-6c2b-454d-9187-f4559ef4e331', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:55:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4be11f-988c-4397-9a6f-cb8e12dcae17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:55:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4be11f-988c-4397-9a6f-cb8e12dcae17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:55:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa2b2440-a8f3-4d53-8c9d-177ce82d1355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:55:20 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Volume cea75e7d-6c2b-454d-9187-f4559ef4e331: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cea75e7d-6c2b-454d-9187-f4559ef4e331', 'volume_size': 1} Apr 28 05:55:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:55:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:55:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-287267020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea75e7d-6c2b-454d-9187-f4559ef4e331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c350d07922468889698bda930ac392',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:55:21Z,use_quota=True,user_id='d95e8e0e1abd4c4db001e8a89cb1a5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:55:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Creating volume cea75e7d-6c2b-454d-9187-f4559ef4e331 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:55:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:55:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:55:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:55:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:55:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:55:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:55:20 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:55:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cea75e7d-6c2b-454d-9187-f4559ef4e331 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:20 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cea75e7d-6c2b-454d-9187-f4559ef4e331 1073741824 Apr 28 05:55:20 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:21 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cea75e7d-6c2b-454d-9187-f4559ef4e331 1073741824" returned: 0 in 0.638s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cea75e7d-6c2b-454d-9187-f4559ef4e331 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:21 devstack sudo[88992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cea75e7d-6c2b-454d-9187-f4559ef4e331 Apr 28 05:55:21 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:22 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cea75e7d-6c2b-454d-9187-f4559ef4e331" returned: 0 in 0.490s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:55:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:55:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa2b2440-a8f3-4d53-8c9d-177ce82d1355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cea75e7d-6c2b-454d-9187-f4559ef4e331', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:55:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2aba2c-0caf-4525-ba86-56e8dab360b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:55:22 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Volume volume-cea75e7d-6c2b-454d-9187-f4559ef4e331 (cea75e7d-6c2b-454d-9187-f4559ef4e331): created successfully Apr 28 05:55:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2aba2c-0caf-4525-ba86-56e8dab360b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:55:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Flow 'volume_create_manager' (1c82218a-1a1c-48b8-908b-ef5d4802ae54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:55:22 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-4a38c834-5ebf-4364-bc92-b5c7cb26c522 tempest-VolumeQuotasAdminTestJSON-1888156160 None] Created volume successfully. Apr 28 05:55:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7a24b23f-e3a6-4397-8a9f-e2d649bca88c tempest-VolumeQuotasAdminTestJSON-1888156160 None] Acquiring lock "cinder-cea75e7d-6c2b-454d-9187-f4559ef4e331-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:55:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7a24b23f-e3a6-4397-8a9f-e2d649bca88c tempest-VolumeQuotasAdminTestJSON-1888156160 None] Lock "cinder-cea75e7d-6c2b-454d-9187-f4559ef4e331-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:55:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7a24b23f-e3a6-4397-8a9f-e2d649bca88c tempest-VolumeQuotasAdminTestJSON-1888156160 None] Acquiring lock "cinder-quobyte-cea75e7d-6c2b-454d-9187-f4559ef4e331" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:55:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7a24b23f-e3a6-4397-8a9f-e2d649bca88c tempest-VolumeQuotasAdminTestJSON-1888156160 None] Lock "cinder-quobyte-cea75e7d-6c2b-454d-9187-f4559ef4e331" acquired by "delete_volume" :: waited 0.018s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:55:23 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29ee12d-73ec-4192-a55f-86d8b798e0bb]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:55:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7a24b23f-e3a6-4397-8a9f-e2d649bca88c tempest-VolumeQuotasAdminTestJSON-1888156160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cea75e7d-6c2b-454d-9187-f4559ef4e331 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:23 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cea75e7d-6c2b-454d-9187-f4559ef4e331 Apr 28 05:55:23 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:23 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7a24b23f-e3a6-4397-8a9f-e2d649bca88c tempest-VolumeQuotasAdminTestJSON-1888156160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cea75e7d-6c2b-454d-9187-f4559ef4e331" returned: 0 in 0.594s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7a24b23f-e3a6-4397-8a9f-e2d649bca88c tempest-VolumeQuotasAdminTestJSON-1888156160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cea75e7d-6c2b-454d-9187-f4559ef4e331 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:23 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cea75e7d-6c2b-454d-9187-f4559ef4e331 Apr 28 05:55:23 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:24 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7a24b23f-e3a6-4397-8a9f-e2d649bca88c tempest-VolumeQuotasAdminTestJSON-1888156160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cea75e7d-6c2b-454d-9187-f4559ef4e331" returned: 0 in 0.452s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:24 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7a24b23f-e3a6-4397-8a9f-e2d649bca88c tempest-VolumeQuotasAdminTestJSON-1888156160 None] Lock "cinder-quobyte-cea75e7d-6c2b-454d-9187-f4559ef4e331" released by "delete_volume" :: held 1.085s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:55:24 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-7a24b23f-e3a6-4397-8a9f-e2d649bca88c tempest-VolumeQuotasAdminTestJSON-1888156160 None] Created reservations ['c3061d53-7ad0-4391-8c6c-c1fe7f45594f', 'fa289aa1-a2fd-4612-a4da-a231ac721a7f', 'ace5280d-7359-4503-b0c4-d6d21eef1f90', '4ec594d3-d77c-47dd-97af-7f83a07087d8'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:55:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7a24b23f-e3a6-4397-8a9f-e2d649bca88c tempest-VolumeQuotasAdminTestJSON-1888156160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:55:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7a24b23f-e3a6-4397-8a9f-e2d649bca88c tempest-VolumeQuotasAdminTestJSON-1888156160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:55:24 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7a24b23f-e3a6-4397-8a9f-e2d649bca88c tempest-VolumeQuotasAdminTestJSON-1888156160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:55:24 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7a24b23f-e3a6-4397-8a9f-e2d649bca88c tempest-VolumeQuotasAdminTestJSON-1888156160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:55:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7a24b23f-e3a6-4397-8a9f-e2d649bca88c tempest-VolumeQuotasAdminTestJSON-1888156160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:55:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7a24b23f-e3a6-4397-8a9f-e2d649bca88c tempest-VolumeQuotasAdminTestJSON-1888156160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:24 devstack sudo[89003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:55:24 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-284878a2-bf08-43da-a46d-b3f0a04194fe tempest-VolumesActionsTest-996686960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:55:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-284878a2-bf08-43da-a46d-b3f0a04194fe tempest-VolumesActionsTest-996686960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:55:24 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83b4b6a-aa47-473f-a2b7-02a975f028d5]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:55:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-284878a2-bf08-43da-a46d-b3f0a04194fe tempest-VolumesActionsTest-996686960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:24 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 Apr 28 05:55:24 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:24 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7a24b23f-e3a6-4397-8a9f-e2d649bca88c tempest-VolumeQuotasAdminTestJSON-1888156160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.476s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:24 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-7a24b23f-e3a6-4397-8a9f-e2d649bca88c tempest-VolumeQuotasAdminTestJSON-1888156160 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:55:24 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-7a24b23f-e3a6-4397-8a9f-e2d649bca88c tempest-VolumeQuotasAdminTestJSON-1888156160 None] Deleted volume successfully. Apr 28 05:55:24 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7a24b23f-e3a6-4397-8a9f-e2d649bca88c tempest-VolumeQuotasAdminTestJSON-1888156160 None] Lock "cinder-cea75e7d-6c2b-454d-9187-f4559ef4e331-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:55:25 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-284878a2-bf08-43da-a46d-b3f0a04194fe tempest-VolumesActionsTest-996686960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8" returned: 0 in 0.519s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:25 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3b00db-5ebd-41bf-beb6-6196e9182eab]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:55:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-284878a2-bf08-43da-a46d-b3f0a04194fe tempest-VolumesActionsTest-996686960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:25 devstack sudo[89011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 Apr 28 05:55:25 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:25 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:55:25 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Flow 'volume_create_manager' (be043356-7e32-4e62-a679-e8f4e30e7538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:55:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa84401-a3cc-4ea5-aeea-be8e1d5515a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:55:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-284878a2-bf08-43da-a46d-b3f0a04194fe tempest-VolumesActionsTest-996686960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8" returned: 0 in 0.617s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-284878a2-bf08-43da-a46d-b3f0a04194fe tempest-VolumesActionsTest-996686960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 /opt/stack/data/cinder/conversion/fa2b32ec-7928-477a-a8e7-ed2ec46511a8.temp_image.cef2e3cb-18b9-40cf-9c64-145c77c60bc82xqx8uyp.img {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:25 devstack sudo[89016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 /opt/stack/data/cinder/conversion/fa2b32ec-7928-477a-a8e7-ed2ec46511a8.temp_image.cef2e3cb-18b9-40cf-9c64-145c77c60bc82xqx8uyp.img Apr 28 05:55:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa84401-a3cc-4ea5-aeea-be8e1d5515a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1158090209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8baa10-74fb-4edc-8c9b-17e5a636544f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c350d07922468889698bda930ac392',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:55:26Z,use_quota=True,user_id='d95e8e0e1abd4c4db001e8a89cb1a5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:55:25 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe61b06-1053-487d-837f-c8dd2c4efc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:55:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe61b06-1053-487d-837f-c8dd2c4efc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:55:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edca3fd7-44f7-42e5-a9ec-5544771672fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:55:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edca3fd7-44f7-42e5-a9ec-5544771672fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e8baa10-74fb-4edc-8c9b-17e5a636544f', 'volume_name': 'volume-2e8baa10-74fb-4edc-8c9b-17e5a636544f', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:55:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b96df9-9952-46f5-aafd-14755eff3154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:55:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b96df9-9952-46f5-aafd-14755eff3154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:55:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e488a20f-d5af-4ebd-a15e-76ce4a845b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:55:25 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Volume 2e8baa10-74fb-4edc-8c9b-17e5a636544f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e8baa10-74fb-4edc-8c9b-17e5a636544f', 'volume_size': 1} Apr 28 05:55:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:55:29 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-284878a2-bf08-43da-a46d-b3f0a04194fe tempest-VolumesActionsTest-996686960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 /opt/stack/data/cinder/conversion/fa2b32ec-7928-477a-a8e7-ed2ec46511a8.temp_image.cef2e3cb-18b9-40cf-9c64-145c77c60bc82xqx8uyp.img" returned: 0 in 4.280s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:29 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bc2fae-6400-4314-b032-abfb2a878281]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:55:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-284878a2-bf08-43da-a46d-b3f0a04194fe tempest-VolumesActionsTest-996686960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:30 devstack sudo[89030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 Apr 28 05:55:30 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:30 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-284878a2-bf08-43da-a46d-b3f0a04194fe tempest-VolumesActionsTest-996686960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8" returned: 0 in 0.640s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:30 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-284878a2-bf08-43da-a46d-b3f0a04194fe tempest-VolumesActionsTest-996686960 None] Image conversion details: src /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8, size 1024.00 MB, duration 4.28 sec, destination /opt/stack/data/cinder/conversion/fa2b32ec-7928-477a-a8e7-ed2ec46511a8.temp_image.cef2e3cb-18b9-40cf-9c64-145c77c60bc82xqx8uyp.img {{(pid=81829) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:55:30 devstack cinder-volume[81829]: INFO cinder.image.image_utils [None req-284878a2-bf08-43da-a46d-b3f0a04194fe tempest-VolumesActionsTest-996686960 None] Converted 1024.00 MB image at 239.22 MB/s Apr 28 05:55:30 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-284878a2-bf08-43da-a46d-b3f0a04194fe tempest-VolumesActionsTest-996686960 None] cef2e3cb-18b9-40cf-9c64-145c77c60bc8 was raw, no need to convert to raw {{(pid=81829) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 28 05:55:35 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:SELECT=63,cinder:UPDATE=69,cinder:INSERT=17,cinder:DELETE=7 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:55:40 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:UPDATE=59,cinder:SELECT=62,cinder:INSERT=16,cinder:DELETE=3 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:55:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-284878a2-bf08-43da-a46d-b3f0a04194fe tempest-VolumesActionsTest-996686960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 21.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:55:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-284878a2-bf08-43da-a46d-b3f0a04194fe tempest-VolumesActionsTest-996686960 None] Uploaded volume to glance image-id: cef2e3cb-18b9-40cf-9c64-145c77c60bc8. {{(pid=81829) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 28 05:55:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.786s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:55:45 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1158090209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8baa10-74fb-4edc-8c9b-17e5a636544f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c350d07922468889698bda930ac392',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:55:26Z,use_quota=True,user_id='d95e8e0e1abd4c4db001e8a89cb1a5f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:55:45 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Creating volume 2e8baa10-74fb-4edc-8c9b-17e5a636544f {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:55:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:55:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:55:45 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:55:45 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:55:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:55:45 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:55:45 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:55:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2e8baa10-74fb-4edc-8c9b-17e5a636544f 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:45 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-284878a2-bf08-43da-a46d-b3f0a04194fe tempest-VolumesActionsTest-996686960 None] Copy volume to image completed successfully. Apr 28 05:55:45 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2e8baa10-74fb-4edc-8c9b-17e5a636544f 1073741824 Apr 28 05:55:45 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:46 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2e8baa10-74fb-4edc-8c9b-17e5a636544f 1073741824" returned: 0 in 0.627s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2e8baa10-74fb-4edc-8c9b-17e5a636544f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:46 devstack sudo[89044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2e8baa10-74fb-4edc-8c9b-17e5a636544f Apr 28 05:55:46 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:46 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2e8baa10-74fb-4edc-8c9b-17e5a636544f" returned: 0 in 0.474s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:46 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:55:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:55:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e488a20f-d5af-4ebd-a15e-76ce4a845b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e8baa10-74fb-4edc-8c9b-17e5a636544f', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:55:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21575a1a-a020-4677-bbec-08ef982ebf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:55:46 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Volume volume-2e8baa10-74fb-4edc-8c9b-17e5a636544f (2e8baa10-74fb-4edc-8c9b-17e5a636544f): created successfully Apr 28 05:55:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21575a1a-a020-4677-bbec-08ef982ebf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:55:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Flow 'volume_create_manager' (be043356-7e32-4e62-a679-e8f4e30e7538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:55:46 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-711af09b-862e-41af-8343-d86e33f79ead tempest-VolumeQuotasAdminTestJSON-1888156160 None] Created volume successfully. Apr 28 05:55:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:55:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:55:46 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb92d19-c19e-4603-9559-fd4847899581]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:55:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:47 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 Apr 28 05:55:47 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:47 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-737f32dc-be0f-47eb-8522-aeeaba3a9293 tempest-VolumeQuotasAdminTestJSON-31297133 None] Transfer volume completed successfully. Apr 28 05:55:47 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8" returned: 0 in 0.573s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:47 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[568ecd09-7913-429c-843b-09885bebb5b8]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:55:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:47 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 Apr 28 05:55:47 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:48 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8" returned: 0 in 0.534s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 /opt/stack/data/cinder/conversion/fa2b32ec-7928-477a-a8e7-ed2ec46511a8.temp_image.55084dc2-dc26-498f-a873-fb9ce22a7698ehnyni5z.img {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:48 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 /opt/stack/data/cinder/conversion/fa2b32ec-7928-477a-a8e7-ed2ec46511a8.temp_image.55084dc2-dc26-498f-a873-fb9ce22a7698ehnyni5z.img Apr 28 05:55:48 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:48 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f58654f3-c1a2-4afb-9c37-525520a6fb33 tempest-VolumeQuotasAdminTestJSON-1782264786 None] Acquiring lock "cinder-2e8baa10-74fb-4edc-8c9b-17e5a636544f-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:55:48 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f58654f3-c1a2-4afb-9c37-525520a6fb33 tempest-VolumeQuotasAdminTestJSON-1782264786 None] Lock "cinder-2e8baa10-74fb-4edc-8c9b-17e5a636544f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:55:48 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f58654f3-c1a2-4afb-9c37-525520a6fb33 tempest-VolumeQuotasAdminTestJSON-1782264786 None] Acquiring lock "cinder-quobyte-2e8baa10-74fb-4edc-8c9b-17e5a636544f" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:55:48 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f58654f3-c1a2-4afb-9c37-525520a6fb33 tempest-VolumeQuotasAdminTestJSON-1782264786 None] Lock "cinder-quobyte-2e8baa10-74fb-4edc-8c9b-17e5a636544f" acquired by "delete_volume" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:55:48 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7336c54-0bb3-42cb-a98b-77186fca9ad8]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:55:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f58654f3-c1a2-4afb-9c37-525520a6fb33 tempest-VolumeQuotasAdminTestJSON-1782264786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2e8baa10-74fb-4edc-8c9b-17e5a636544f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:48 devstack sudo[89061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2e8baa10-74fb-4edc-8c9b-17e5a636544f Apr 28 05:55:48 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:49 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f58654f3-c1a2-4afb-9c37-525520a6fb33 tempest-VolumeQuotasAdminTestJSON-1782264786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2e8baa10-74fb-4edc-8c9b-17e5a636544f" returned: 0 in 1.149s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f58654f3-c1a2-4afb-9c37-525520a6fb33 tempest-VolumeQuotasAdminTestJSON-1782264786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2e8baa10-74fb-4edc-8c9b-17e5a636544f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:49 devstack sudo[89076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2e8baa10-74fb-4edc-8c9b-17e5a636544f Apr 28 05:55:49 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:50 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f58654f3-c1a2-4afb-9c37-525520a6fb33 tempest-VolumeQuotasAdminTestJSON-1782264786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2e8baa10-74fb-4edc-8c9b-17e5a636544f" returned: 0 in 0.993s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:50 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f58654f3-c1a2-4afb-9c37-525520a6fb33 tempest-VolumeQuotasAdminTestJSON-1782264786 None] Lock "cinder-quobyte-2e8baa10-74fb-4edc-8c9b-17e5a636544f" released by "delete_volume" :: held 2.185s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:55:50 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-f58654f3-c1a2-4afb-9c37-525520a6fb33 tempest-VolumeQuotasAdminTestJSON-1782264786 None] Created reservations ['d1ea613b-a7bb-4228-a4e6-b997336c54b0', '3b9288ef-dce8-405f-9ffb-dc6e16d271fc', '4e875d49-de8d-4768-a1b5-8ed1e5b7fadd', 'd59ef242-c6c2-4a9d-b0fd-8902d093c022'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:55:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f58654f3-c1a2-4afb-9c37-525520a6fb33 tempest-VolumeQuotasAdminTestJSON-1782264786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:55:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f58654f3-c1a2-4afb-9c37-525520a6fb33 tempest-VolumeQuotasAdminTestJSON-1782264786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:55:50 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f58654f3-c1a2-4afb-9c37-525520a6fb33 tempest-VolumeQuotasAdminTestJSON-1782264786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:55:50 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f58654f3-c1a2-4afb-9c37-525520a6fb33 tempest-VolumeQuotasAdminTestJSON-1782264786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:55:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f58654f3-c1a2-4afb-9c37-525520a6fb33 tempest-VolumeQuotasAdminTestJSON-1782264786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:55:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f58654f3-c1a2-4afb-9c37-525520a6fb33 tempest-VolumeQuotasAdminTestJSON-1782264786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:50 devstack sudo[89079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:55:50 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:52 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f58654f3-c1a2-4afb-9c37-525520a6fb33 tempest-VolumeQuotasAdminTestJSON-1782264786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 1.591s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:52 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-f58654f3-c1a2-4afb-9c37-525520a6fb33 tempest-VolumeQuotasAdminTestJSON-1782264786 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:55:52 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-f58654f3-c1a2-4afb-9c37-525520a6fb33 tempest-VolumeQuotasAdminTestJSON-1782264786 None] Deleted volume successfully. Apr 28 05:55:52 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f58654f3-c1a2-4afb-9c37-525520a6fb33 tempest-VolumeQuotasAdminTestJSON-1782264786 None] Lock "cinder-2e8baa10-74fb-4edc-8c9b-17e5a636544f-delete_volume" released by "delete_volume" :: held 4.064s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:55:53 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 /opt/stack/data/cinder/conversion/fa2b32ec-7928-477a-a8e7-ed2ec46511a8.temp_image.55084dc2-dc26-498f-a873-fb9ce22a7698ehnyni5z.img" returned: 0 in 4.970s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:53 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcab2c1-25eb-4463-ab6f-1414fc8c958b]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:55:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:53 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 Apr 28 05:55:53 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:53 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8" returned: 0 in 0.734s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:53 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] Image conversion details: src /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/conversion/fa2b32ec-7928-477a-a8e7-ed2ec46511a8.temp_image.55084dc2-dc26-498f-a873-fb9ce22a7698ehnyni5z.img {{(pid=81829) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:55:53 devstack cinder-volume[81829]: INFO cinder.image.image_utils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] Converted 1024.00 MB image at 206.00 MB/s Apr 28 05:55:53 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] 55084dc2-dc26-498f-a873-fb9ce22a7698 was raw, converting to qcow2 {{(pid=81829) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 28 05:55:53 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a35999-375f-41cf-8ddb-3d4a4c90a441]: (4, 'raw') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:55:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fa2b32ec-7928-477a-a8e7-ed2ec46511a8.temp_image.55084dc2-dc26-498f-a873-fb9ce22a7698ehnyni5z.img {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:53 devstack sudo[89094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fa2b32ec-7928-477a-a8e7-ed2ec46511a8.temp_image.55084dc2-dc26-498f-a873-fb9ce22a7698ehnyni5z.img Apr 28 05:55:53 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:54 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fa2b32ec-7928-477a-a8e7-ed2ec46511a8.temp_image.55084dc2-dc26-498f-a873-fb9ce22a7698ehnyni5z.img" returned: 0 in 0.524s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fa2b32ec-7928-477a-a8e7-ed2ec46511a8.temp_image.55084dc2-dc26-498f-a873-fb9ce22a7698ehnyni5z.img {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:54 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fa2b32ec-7928-477a-a8e7-ed2ec46511a8.temp_image.55084dc2-dc26-498f-a873-fb9ce22a7698ehnyni5z.img Apr 28 05:55:54 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:54 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fa2b32ec-7928-477a-a8e7-ed2ec46511a8.temp_image.55084dc2-dc26-498f-a873-fb9ce22a7698ehnyni5z.img" returned: 1 in 0.510s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fa2b32ec-7928-477a-a8e7-ed2ec46511a8.temp_image.55084dc2-dc26-498f-a873-fb9ce22a7698ehnyni5z.img' failed. Not Retrying. {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 05:55:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fa2b32ec-7928-477a-a8e7-ed2ec46511a8.temp_image.55084dc2-dc26-498f-a873-fb9ce22a7698ehnyni5z.img /opt/stack/data/cinder/conversion/vol_upload_24je46d3 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:54 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fa2b32ec-7928-477a-a8e7-ed2ec46511a8.temp_image.55084dc2-dc26-498f-a873-fb9ce22a7698ehnyni5z.img /opt/stack/data/cinder/conversion/vol_upload_24je46d3 Apr 28 05:55:54 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:55 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fa2b32ec-7928-477a-a8e7-ed2ec46511a8.temp_image.55084dc2-dc26-498f-a873-fb9ce22a7698ehnyni5z.img /opt/stack/data/cinder/conversion/vol_upload_24je46d3" returned: 0 in 0.529s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:55 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] Image conversion details: src /opt/stack/data/cinder/conversion/fa2b32ec-7928-477a-a8e7-ed2ec46511a8.temp_image.55084dc2-dc26-498f-a873-fb9ce22a7698ehnyni5z.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_24je46d3 {{(pid=81829) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:55:55 devstack cinder-volume[81829]: INFO cinder.image.image_utils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 28 05:55:55 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78b2092-78d0-46e1-98c0-86a9b64a15bf]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:55:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_24je46d3 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:55 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_24je46d3 Apr 28 05:55:55 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:55 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_24je46d3" returned: 0 in 0.524s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.456s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:55:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] Uploaded volume to glance image-id: 55084dc2-dc26-498f-a873-fb9ce22a7698. {{(pid=81829) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 28 05:55:57 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-c25c221f-0c20-438d-8056-c71c744506a4 tempest-VolumesActionsTest-996686960 None] Copy volume to image completed successfully. Apr 28 05:55:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-53b3d3ef-fa43-481f-bfc9-cbfa0707b916 tempest-VolumesActionsTest-996686960 None] Acquiring lock "cinder-fa2b32ec-7928-477a-a8e7-ed2ec46511a8-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:55:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-53b3d3ef-fa43-481f-bfc9-cbfa0707b916 tempest-VolumesActionsTest-996686960 None] Lock "cinder-fa2b32ec-7928-477a-a8e7-ed2ec46511a8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:55:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-53b3d3ef-fa43-481f-bfc9-cbfa0707b916 tempest-VolumesActionsTest-996686960 None] Acquiring lock "cinder-quobyte-fa2b32ec-7928-477a-a8e7-ed2ec46511a8" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:55:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-53b3d3ef-fa43-481f-bfc9-cbfa0707b916 tempest-VolumesActionsTest-996686960 None] Lock "cinder-quobyte-fa2b32ec-7928-477a-a8e7-ed2ec46511a8" acquired by "delete_volume" :: waited 0.025s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:55:59 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[92735d7b-9c7b-414f-8265-6e8c000687c7]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:55:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-53b3d3ef-fa43-481f-bfc9-cbfa0707b916 tempest-VolumesActionsTest-996686960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:59 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 Apr 28 05:55:59 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:55:59 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Apr 28 05:55:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-53b3d3ef-fa43-481f-bfc9-cbfa0707b916 tempest-VolumesActionsTest-996686960 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8" returned: 0 in 0.574s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:55:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-53b3d3ef-fa43-481f-bfc9-cbfa0707b916 tempest-VolumesActionsTest-996686960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:55:59 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8 Apr 28 05:55:59 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:00 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-53b3d3ef-fa43-481f-bfc9-cbfa0707b916 tempest-VolumesActionsTest-996686960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fa2b32ec-7928-477a-a8e7-ed2ec46511a8" returned: 0 in 0.509s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:00 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-53b3d3ef-fa43-481f-bfc9-cbfa0707b916 tempest-VolumesActionsTest-996686960 None] Lock "cinder-quobyte-fa2b32ec-7928-477a-a8e7-ed2ec46511a8" released by "delete_volume" :: held 1.129s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:56:00 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-53b3d3ef-fa43-481f-bfc9-cbfa0707b916 tempest-VolumesActionsTest-996686960 None] Created reservations ['99476649-6a45-4abd-8390-92ddcd6fa6bf', '550b531d-90ed-494d-a8d0-a6421e6c6857', '6533d7e1-4b9c-4f3f-a2ee-b89d2a94f367', 'fd0064c2-096c-4dbd-975c-f8906ab2a62a'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:56:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-53b3d3ef-fa43-481f-bfc9-cbfa0707b916 tempest-VolumesActionsTest-996686960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-53b3d3ef-fa43-481f-bfc9-cbfa0707b916 tempest-VolumesActionsTest-996686960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:00 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-53b3d3ef-fa43-481f-bfc9-cbfa0707b916 tempest-VolumesActionsTest-996686960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:56:00 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-53b3d3ef-fa43-481f-bfc9-cbfa0707b916 tempest-VolumesActionsTest-996686960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:56:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-53b3d3ef-fa43-481f-bfc9-cbfa0707b916 tempest-VolumesActionsTest-996686960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-53b3d3ef-fa43-481f-bfc9-cbfa0707b916 tempest-VolumesActionsTest-996686960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:00 devstack sudo[89124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:56:00 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:00 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-53b3d3ef-fa43-481f-bfc9-cbfa0707b916 tempest-VolumesActionsTest-996686960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.488s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:00 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-53b3d3ef-fa43-481f-bfc9-cbfa0707b916 tempest-VolumesActionsTest-996686960 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:56:00 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-53b3d3ef-fa43-481f-bfc9-cbfa0707b916 tempest-VolumesActionsTest-996686960 None] Deleted volume successfully. Apr 28 05:56:00 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-53b3d3ef-fa43-481f-bfc9-cbfa0707b916 tempest-VolumesActionsTest-996686960 None] Lock "cinder-fa2b32ec-7928-477a-a8e7-ed2ec46511a8-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:56:04 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:56:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Flow 'volume_create_manager' (0b378205-6fc2-443e-a08a-8bcf84deffcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:56:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934811e9-1f29-49f6-9433-f31c2ee4565a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934811e9-1f29-49f6-9433-f31c2ee4565a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1108303935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6839be5-3ce4-4fa0-8d15-7fbd651fe277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae112917a96f40c38548e8e649e40654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:56:04Z,use_quota=True,user_id='6cf7f6171b9344819984caa3b92ea8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f6d1e66-95b1-4f77-a473-c5d8d54afe67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f6d1e66-95b1-4f77-a473-c5d8d54afe67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea6ec11-293a-4f24-8fb7-3378cbc00391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:04 devstack cinder-volume[81829]: DEBUG cinder.image.glance [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Creating Keystone auth plugin from conf {{(pid=81829) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 28 05:56:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea6ec11-293a-4f24-8fb7-3378cbc00391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c6839be5-3ce4-4fa0-8d15-7fbd651fe277', 'volume_name': 'volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277', 'volume_size': 1, 'image_id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe365410c9347328bf4beafdac90830', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'created_at': datetime.datetime(2026, 4, 28, 3, 43, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 3, 43, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25b85b0b-bf76-421a-869b-c686c236a28b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55faf5f3-312e-4bfd-a1fd-3553605f88e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55faf5f3-312e-4bfd-a1fd-3553605f88e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9657ca87-c8de-4b1f-af98-288e14bd11b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:04 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Volume c6839be5-3ce4-4fa0-8d15-7fbd651fe277: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277', 'volume_size': 1, 'image_id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe365410c9347328bf4beafdac90830', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'created_at': datetime.datetime(2026, 4, 28, 3, 43, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 3, 43, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25b85b0b-bf76-421a-869b-c686c236a28b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 28 05:56:04 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Trying to clone c6839be5-3ce4-4fa0-8d15-7fbd651fe277 from image 25b85b0b-bf76-421a-869b-c686c236a28b at location (None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}]). {{(pid=81829) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 28 05:56:05 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_io8kyozpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81829) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 28 05:56:05 devstack cinder-volume[81829]: INFO cinder.image.image_utils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Image download 20.69 MB at 20.69 MB/s Apr 28 05:56:05 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a88d13c-a8e5-4274-af67-f5175843a9a5]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_io8kyozpdevstack@QuobyteHD {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:05 devstack sudo[89131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_io8kyozpdevstack@QuobyteHD Apr 28 05:56:05 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:05 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_io8kyozpdevstack@QuobyteHD" returned: 0 in 0.587s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:05 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Temporary image 25b85b0b-bf76-421a-869b-c686c236a28b is fetched for user 6cf7f6171b9344819984caa3b92ea8ae. {{(pid=81829) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 28 05:56:05 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b502f6-e85e-4f5f-9743-de471117da61]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_io8kyozpdevstack@QuobyteHD {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:05 devstack sudo[89136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_io8kyozpdevstack@QuobyteHD Apr 28 05:56:05 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:06 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_io8kyozpdevstack@QuobyteHD" returned: 0 in 0.564s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1108303935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6839be5-3ce4-4fa0-8d15-7fbd651fe277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae112917a96f40c38548e8e649e40654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:56:04Z,use_quota=True,user_id='6cf7f6171b9344819984caa3b92ea8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Creating volume c6839be5-3ce4-4fa0-8d15-7fbd651fe277 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:56:06 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:06 devstack sudo[89141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277 1073741824 Apr 28 05:56:06 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Flow 'volume_create_manager' (2cdaf6bf-bff6-4547-bb13-7a78c081b14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8db1f84-0663-4305-a396-acff459d5f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8db1f84-0663-4305-a396-acff459d5f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1802271688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f466fcf9-87e1-4f30-8a50-c5415809688d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b145256134d24437aa0857d517a2b6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:56:07Z,use_quota=True,user_id='c63149eaf9a947de89f9f892057ccbcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba81551-9ecf-4ff7-a783-0906d4007d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba81551-9ecf-4ff7-a783-0906d4007d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37fa149e-f550-42f0-ab1a-500f0aab9898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37fa149e-f550-42f0-ab1a-500f0aab9898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f466fcf9-87e1-4f30-8a50-c5415809688d', 'volume_name': 'volume-f466fcf9-87e1-4f30-8a50-c5415809688d', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd87eb3-4f5e-4679-a030-b8290017eb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd87eb3-4f5e-4679-a030-b8290017eb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e1ba93-f43b-4355-a0f4-18020421e3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:06 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Volume f466fcf9-87e1-4f30-8a50-c5415809688d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f466fcf9-87e1-4f30-8a50-c5415809688d', 'volume_size': 1} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG oslo_service.periodic_task [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81829) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:06 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:56:06 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:07 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277 1073741824" returned: 0 in 0.626s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:07 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277 Apr 28 05:56:07 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:07 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.457s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:07 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:56:07 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277" returned: 0 in 0.450s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:07 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:56:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.627s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:07 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1802271688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f466fcf9-87e1-4f30-8a50-c5415809688d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b145256134d24437aa0857d517a2b6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:56:07Z,use_quota=True,user_id='c63149eaf9a947de89f9f892057ccbcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:56:07 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Creating volume f466fcf9-87e1-4f30-8a50-c5415809688d {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:56:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:07 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:56:07 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:56:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:07 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:56:07 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:56:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:07 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d 1073741824 Apr 28 05:56:07 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:07 devstack cinder-volume[81829]: DEBUG cinder.volume.volume_utils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Attempting download of 25b85b0b-bf76-421a-869b-c686c236a28b ((None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}])) to volume c6839be5-3ce4-4fa0-8d15-7fbd651fe277. {{(pid=81829) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 28 05:56:07 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d7d913-7d05-441f-9d7a-46088301b748]: (4, 'raw') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_683br8pm {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:07 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_683br8pm Apr 28 05:56:07 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:08 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d 1073741824" returned: 0 in 0.610s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:08 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_683br8pm" returned: 0 in 0.558s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_683br8pm {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:08 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d Apr 28 05:56:08 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:08 devstack sudo[89161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_683br8pm Apr 28 05:56:08 devstack sudo[89161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:08 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d" returned: 0 in 0.446s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:56:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e1ba93-f43b-4355-a0f4-18020421e3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f466fcf9-87e1-4f30-8a50-c5415809688d', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ad3b84-7818-4a1a-b050-61489301d523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:08 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Volume volume-f466fcf9-87e1-4f30-8a50-c5415809688d (f466fcf9-87e1-4f30-8a50-c5415809688d): created successfully Apr 28 05:56:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ad3b84-7818-4a1a-b050-61489301d523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Flow 'volume_create_manager' (2cdaf6bf-bff6-4547-bb13-7a78c081b14e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:56:08 devstack sudo[89161]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_683br8pm" returned: 1 in 0.512s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_683br8pm' failed. Not Retrying. {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 05:56:08 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-a89f04db-bf99-4dc8-8289-591c78e95963 tempest-VolumesCloneTest-1517424155 None] Created volume successfully. Apr 28 05:56:08 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d3c002-ccdc-4967-b926-be30a17b1694]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_io8kyozpdevstack@QuobyteHD {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:08 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_io8kyozpdevstack@QuobyteHD Apr 28 05:56:08 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:09 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_io8kyozpdevstack@QuobyteHD" returned: 0 in 0.523s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:09 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] 25b85b0b-bf76-421a-869b-c686c236a28b was qcow2, converting to raw {{(pid=81829) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 28 05:56:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_io8kyozpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:09 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_io8kyozpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277 Apr 28 05:56:09 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:09 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:56:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Flow 'volume_create_manager' (d07ef3e9-99e0-4d25-b2a9-c3298ffdacd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:56:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f0e2e9-75c9-4259-919b-00f8de934104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f0e2e9-75c9-4259-919b-00f8de934104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2020695067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829fe991-1d43-4b42-a44f-5858584eaa3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b145256134d24437aa0857d517a2b6a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:56:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=f466fcf9-87e1-4f30-8a50-c5415809688d,status='creating',terminated_at=None,updated_at=2026-04-28T03:56:09Z,use_quota=True,user_id='c63149eaf9a947de89f9f892057ccbcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f5dad5-d888-4e72-bcb1-8879deb98fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f5dad5-d888-4e72-bcb1-8879deb98fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d517e8-74bd-4565-bc02-c81cd4abff22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d517e8-74bd-4565-bc02-c81cd4abff22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '829fe991-1d43-4b42-a44f-5858584eaa3f', 'volume_name': 'volume-829fe991-1d43-4b42-a44f-5858584eaa3f', 'volume_size': 2, 'source_volid': 'f466fcf9-87e1-4f30-8a50-c5415809688d', 'source_volstatus': 'available'}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11ce9cba-621a-476c-83cb-e4ef525a31e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11ce9cba-621a-476c-83cb-e4ef525a31e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59e4fd1-de45-4b22-afd0-e830705d2524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:09 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Volume 829fe991-1d43-4b42-a44f-5858584eaa3f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-829fe991-1d43-4b42-a44f-5858584eaa3f', 'volume_size': 2, 'source_volid': 'f466fcf9-87e1-4f30-8a50-c5415809688d', 'source_volstatus': 'available'} Apr 28 05:56:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:09 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Cloning volume f466fcf9-87e1-4f30-8a50-c5415809688d to volume 829fe991-1d43-4b42-a44f-5858584eaa3f Apr 28 05:56:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Creating offline snapshot c502af26-1743-4189-acee-34ea0354659c of volume f466fcf9-87e1-4f30-8a50-c5415809688d {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:56:09 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d19849-904c-4674-b950-9188c9381f94]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:09 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d Apr 28 05:56:09 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:10 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d" returned: 0 in 0.595s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:10 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c 1G Apr 28 05:56:10 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:10 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_io8kyozpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277" returned: 0 in 1.383s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:10 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_io8kyozpdevstack@QuobyteHD, size 112.00 MB, duration 1.39 sec, destination /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277 {{(pid=81829) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:56:10 devstack cinder-volume[81829]: INFO cinder.image.image_utils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Converted 112.00 MB image at 80.84 MB/s Apr 28 05:56:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:10 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277 1G Apr 28 05:56:10 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:10 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c 1G" returned: 0 in 0.688s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f466fcf9-87e1-4f30-8a50-c5415809688d -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:10 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f466fcf9-87e1-4f30-8a50-c5415809688d -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c Apr 28 05:56:10 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:11 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277 1G" returned: 0 in 0.471s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:11 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8c9c5f-52e2-4bed-8b39-d0f1813b69ef]: (4, 'raw') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:11 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277 Apr 28 05:56:11 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:11 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f466fcf9-87e1-4f30-8a50-c5415809688d -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c" returned: 0 in 0.501s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:11 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c is being set with open permissions: ugo+rw Apr 28 05:56:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:11 devstack sudo[89207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c Apr 28 05:56:11 devstack sudo[89207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:11 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277" returned: 0 in 0.509s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:11 devstack sudo[89207]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c" returned: 0 in 0.461s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:11 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277 Apr 28 05:56:11 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:11 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.info Apr 28 05:56:11 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:12 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277" returned: 1 in 0.519s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277' failed. Not Retrying. {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG cinder.volume.volume_utils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Downloaded image 25b85b0b-bf76-421a-869b-c686c236a28b ((None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}])) to volume c6839be5-3ce4-4fa0-8d15-7fbd651fe277 successfully. {{(pid=81829) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Temporary image 25b85b0b-bf76-421a-869b-c686c236a28b for user 6cf7f6171b9344819984caa3b92ea8ae is deleted. {{(pid=81829) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG cinder.volume.volume_utils [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Marking volume c6839be5-3ce4-4fa0-8d15-7fbd651fe277 as bootable. {{(pid=81829) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 28 05:56:12 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Copying metadata from image 25b85b0b-bf76-421a-869b-c686c236a28b to c6839be5-3ce4-4fa0-8d15-7fbd651fe277. {{(pid=81829) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Creating volume glance metadata for volume c6839be5-3ce4-4fa0-8d15-7fbd651fe277 backed by image 25b85b0b-bf76-421a-869b-c686c236a28b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81829) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.info" returned: 0 in 0.461s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:12 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.info is being set with open permissions: ugo+rw Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:12 devstack sudo[89220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.info Apr 28 05:56:12 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9657ca87-c8de-4b1f-af98-288e14bd11b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277', 'volume_size': 1, 'image_id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe365410c9347328bf4beafdac90830', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'created_at': datetime.datetime(2026, 4, 28, 3, 43, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 3, 43, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25b85b0b-bf76-421a-869b-c686c236a28b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad582ab-8871-4f1a-823a-1b6a21894797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:12 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Volume volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277 (c6839be5-3ce4-4fa0-8d15-7fbd651fe277): created successfully Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad582ab-8871-4f1a-823a-1b6a21894797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Flow 'volume_create_manager' (0b378205-6fc2-443e-a08a-8bcf84deffcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:56:12 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-aeb3e6d0-e28a-452b-a913-849651d03533 tempest-VolumesImageMetadata-227218905 None] Created volume successfully. Apr 28 05:56:12 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.info" returned: 0 in 0.440s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Acquiring lock "cinder-quobyte-829fe991-1d43-4b42-a44f-5858584eaa3f" by "_copy_volume_from_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Lock "cinder-quobyte-829fe991-1d43-4b42-a44f-5858584eaa3f" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] snapshot: c502af26-1743-4189-acee-34ea0354659c, volume: 829fe991-1d43-4b42-a44f-5858584eaa3f, {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[3552c600-f3b7-4520-99f3-5f2e17b61ada]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:12 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c Apr 28 05:56:12 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:13 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c" returned: 0 in 0.559s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:13 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f466fcf9-87e1-4f30-8a50-c5415809688d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:56:13 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] will copy from snapshot at /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 05:56:13 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Creating direct copy from snapshot {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 05:56:13 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6c7222-e3ac-444c-a3da-727176629888]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:13 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d Apr 28 05:56:13 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:13 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] Acquiring lock "cinder-c6839be5-3ce4-4fa0-8d15-7fbd651fe277-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:56:13 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] Lock "cinder-c6839be5-3ce4-4fa0-8d15-7fbd651fe277-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:56:13 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] Acquiring lock "cinder-quobyte-c6839be5-3ce4-4fa0-8d15-7fbd651fe277" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:56:13 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] Lock "cinder-quobyte-c6839be5-3ce4-4fa0-8d15-7fbd651fe277" acquired by "delete_volume" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:56:13 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed5a5b6-5635-4a37-be57-cb1114078f7f]: (4, 'raw') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:13 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277 Apr 28 05:56:13 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:13 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d" returned: 0 in 0.554s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:13 devstack cinder-volume[81829]: DEBUG cinder.utils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Path /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-829fe991-1d43-4b42-a44f-5858584eaa3f not found in is_blk_device check {{(pid=81829) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 05:56:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-829fe991-1d43-4b42-a44f-5858584eaa3f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:13 devstack sudo[89236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-829fe991-1d43-4b42-a44f-5858584eaa3f Apr 28 05:56:13 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:13 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277" returned: 0 in 0.519s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:14 devstack sudo[89240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277 Apr 28 05:56:14 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:14 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277" returned: 1 in 0.718s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277' failed. Not Retrying. {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 05:56:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:14 devstack sudo[89255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277 Apr 28 05:56:14 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:15 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c6839be5-3ce4-4fa0-8d15-7fbd651fe277" returned: 0 in 0.974s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] Lock "cinder-quobyte-c6839be5-3ce4-4fa0-8d15-7fbd651fe277" released by "delete_volume" :: held 2.292s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:56:15 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] Created reservations ['7f3c75a9-75ea-4c1a-8941-46d33596ae47', '7c37904d-4bd1-4f31-87d5-85d7d2b671f4', '6a32dd05-5715-4c4e-8b1c-4836bdea45b4', '6b4a3358-a904-47e0-9cbc-0730420f0934'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:56:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:56:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:56:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:15 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:56:15 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:16 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.986s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:16 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:56:16 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] Deleted volume successfully. Apr 28 05:56:16 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c288fa38-5c64-4f82-a09e-363d78b6a903 tempest-VolumesImageMetadata-227218905 None] Lock "cinder-c6839be5-3ce4-4fa0-8d15-7fbd651fe277-delete_volume" released by "delete_volume" :: held 3.585s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:56:18 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-829fe991-1d43-4b42-a44f-5858584eaa3f" returned: 0 in 5.028s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:18 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7f53a6-9117-4bb7-a432-4c52fec0a63f]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:18 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d Apr 28 05:56:18 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:19 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d" returned: 0 in 0.743s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:19 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Image conversion details: src /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-829fe991-1d43-4b42-a44f-5858584eaa3f {{(pid=81829) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:56:19 devstack cinder-volume[81829]: INFO cinder.image.image_utils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Converted 1024.00 MB image at 203.60 MB/s Apr 28 05:56:19 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-829fe991-1d43-4b42-a44f-5858584eaa3f is being set with open permissions: ugo+rw Apr 28 05:56:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-829fe991-1d43-4b42-a44f-5858584eaa3f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:19 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-829fe991-1d43-4b42-a44f-5858584eaa3f Apr 28 05:56:19 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:20 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-829fe991-1d43-4b42-a44f-5858584eaa3f" returned: 0 in 0.445s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Lock "cinder-quobyte-829fe991-1d43-4b42-a44f-5858584eaa3f" released by "_copy_volume_from_snapshot" :: held 7.407s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Acquiring lock "cinder-quobyte-c502af26-1743-4189-acee-34ea0354659c" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Lock "cinder-quobyte-c502af26-1743-4189-acee-34ea0354659c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Deleting offline snapshot c502af26-1743-4189-acee-34ea0354659c of volume f466fcf9-87e1-4f30-8a50-c5415809688d {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] snapshot_file for this snap is: volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f437615-c9c8-4bd3-8edb-cc73b728ac1b]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:20 devstack sudo[89269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c Apr 28 05:56:20 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Flow 'volume_create_manager' (099c34fd-1c0a-489d-ba77-8aac71637910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5c4c5d-5ef2-49e4-83d2-29fe9dfb7d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5c4c5d-5ef2-49e4-83d2-29fe9dfb7d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1325742209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24522d0-86dc-45bc-a3e8-2f9277cbe66a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1650292d792f4785bff2f03ddbb5f501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:56:20Z,use_quota=True,user_id='6f86517798bd4de9b25de4f2174f05e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93cbf00e-005d-406f-b4d6-6b9a889340bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93cbf00e-005d-406f-b4d6-6b9a889340bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0a2cc2-2271-4d25-bbfc-9eca9d733338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0a2cc2-2271-4d25-bbfc-9eca9d733338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd24522d0-86dc-45bc-a3e8-2f9277cbe66a', 'volume_name': 'volume-d24522d0-86dc-45bc-a3e8-2f9277cbe66a', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17767b11-4b44-43fc-bfe9-c933911b5849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17767b11-4b44-43fc-bfe9-c933911b5849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (997811e1-22b6-42ee-b6d7-aeb8cb17ea25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:20 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Volume d24522d0-86dc-45bc-a3e8-2f9277cbe66a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d24522d0-86dc-45bc-a3e8-2f9277cbe66a', 'volume_size': 1} Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:20 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c" returned: 0 in 0.561s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f466fcf9-87e1-4f30-8a50-c5415809688d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea043913-875a-470a-a3ac-7e4b8d216912]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:20 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d Apr 28 05:56:20 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:21 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d" returned: 0 in 0.538s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:21 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c Apr 28 05:56:21 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:21 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c" returned: 0 in 0.530s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:21 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c Apr 28 05:56:21 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:22 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d.c502af26-1743-4189-acee-34ea0354659c" returned: 0 in 0.441s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:22 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Lock "cinder-quobyte-c502af26-1743-4189-acee-34ea0354659c" released by "_delete_snapshot" :: held 2.182s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:56:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.923s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.836s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1325742209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24522d0-86dc-45bc-a3e8-2f9277cbe66a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1650292d792f4785bff2f03ddbb5f501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:56:20Z,use_quota=True,user_id='6f86517798bd4de9b25de4f2174f05e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:56:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Creating volume d24522d0-86dc-45bc-a3e8-2f9277cbe66a {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:56:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:56:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:56:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:56:22 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:56:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d24522d0-86dc-45bc-a3e8-2f9277cbe66a 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59e4fd1-de45-4b22-afd0-e830705d2524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-829fe991-1d43-4b42-a44f-5858584eaa3f', 'volume_size': 2, 'source_volid': 'f466fcf9-87e1-4f30-8a50-c5415809688d', 'source_volstatus': 'available'}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:22 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d24522d0-86dc-45bc-a3e8-2f9277cbe66a 1073741824 Apr 28 05:56:22 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f55cfb1-69fb-4b4e-a619-abe8ec3902d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:22 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Volume volume-829fe991-1d43-4b42-a44f-5858584eaa3f (829fe991-1d43-4b42-a44f-5858584eaa3f): created successfully Apr 28 05:56:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f55cfb1-69fb-4b4e-a619-abe8ec3902d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Flow 'volume_create_manager' (d07ef3e9-99e0-4d25-b2a9-c3298ffdacd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:56:22 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-e89108ce-cefd-4339-b2dd-9efaddb7b5dc tempest-VolumesCloneTest-1517424155 None] Created volume successfully. Apr 28 05:56:22 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d24522d0-86dc-45bc-a3e8-2f9277cbe66a 1073741824" returned: 0 in 0.621s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d24522d0-86dc-45bc-a3e8-2f9277cbe66a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:22 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d24522d0-86dc-45bc-a3e8-2f9277cbe66a Apr 28 05:56:22 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:23 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d24522d0-86dc-45bc-a3e8-2f9277cbe66a" returned: 0 in 0.449s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:23 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:56:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:23 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (997811e1-22b6-42ee-b6d7-aeb8cb17ea25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d24522d0-86dc-45bc-a3e8-2f9277cbe66a', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:23 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6547ab89-f87c-4173-8414-37305c1d735d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:23 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Volume volume-d24522d0-86dc-45bc-a3e8-2f9277cbe66a (d24522d0-86dc-45bc-a3e8-2f9277cbe66a): created successfully Apr 28 05:56:23 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6547ab89-f87c-4173-8414-37305c1d735d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:23 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Flow 'volume_create_manager' (099c34fd-1c0a-489d-ba77-8aac71637910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:56:23 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-68822399-c0ec-4451-b370-215e3749728e tempest-VolumesMetadataTest-67814352 None] Created volume successfully. Apr 28 05:56:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-766a021a-aaf0-40ed-ae21-a21c6cc18131 tempest-VolumesCloneTest-1517424155 None] Acquiring lock "cinder-829fe991-1d43-4b42-a44f-5858584eaa3f-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:56:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-766a021a-aaf0-40ed-ae21-a21c6cc18131 tempest-VolumesCloneTest-1517424155 None] Lock "cinder-829fe991-1d43-4b42-a44f-5858584eaa3f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:56:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-766a021a-aaf0-40ed-ae21-a21c6cc18131 tempest-VolumesCloneTest-1517424155 None] Acquiring lock "cinder-quobyte-829fe991-1d43-4b42-a44f-5858584eaa3f" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:56:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-766a021a-aaf0-40ed-ae21-a21c6cc18131 tempest-VolumesCloneTest-1517424155 None] Lock "cinder-quobyte-829fe991-1d43-4b42-a44f-5858584eaa3f" acquired by "delete_volume" :: waited 0.013s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:56:23 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a70e0e-dde6-4966-8976-e629219b310b]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-766a021a-aaf0-40ed-ae21-a21c6cc18131 tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-829fe991-1d43-4b42-a44f-5858584eaa3f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:23 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-829fe991-1d43-4b42-a44f-5858584eaa3f Apr 28 05:56:23 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:24 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-766a021a-aaf0-40ed-ae21-a21c6cc18131 tempest-VolumesCloneTest-1517424155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-829fe991-1d43-4b42-a44f-5858584eaa3f" returned: 0 in 0.566s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-766a021a-aaf0-40ed-ae21-a21c6cc18131 tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-829fe991-1d43-4b42-a44f-5858584eaa3f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:24 devstack sudo[89335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-829fe991-1d43-4b42-a44f-5858584eaa3f Apr 28 05:56:24 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:24 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4db11af8-f457-4d98-83a3-53681bcf8e02 tempest-VolumesMetadataTest-67814352 None] Acquiring lock "cinder-d24522d0-86dc-45bc-a3e8-2f9277cbe66a-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:56:24 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4db11af8-f457-4d98-83a3-53681bcf8e02 tempest-VolumesMetadataTest-67814352 None] Lock "cinder-d24522d0-86dc-45bc-a3e8-2f9277cbe66a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:56:24 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4db11af8-f457-4d98-83a3-53681bcf8e02 tempest-VolumesMetadataTest-67814352 None] Acquiring lock "cinder-quobyte-d24522d0-86dc-45bc-a3e8-2f9277cbe66a" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:56:24 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4db11af8-f457-4d98-83a3-53681bcf8e02 tempest-VolumesMetadataTest-67814352 None] Lock "cinder-quobyte-d24522d0-86dc-45bc-a3e8-2f9277cbe66a" acquired by "delete_volume" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:56:24 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab90838-6671-47c7-aa7e-e05e20054604]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4db11af8-f457-4d98-83a3-53681bcf8e02 tempest-VolumesMetadataTest-67814352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d24522d0-86dc-45bc-a3e8-2f9277cbe66a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:24 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d24522d0-86dc-45bc-a3e8-2f9277cbe66a Apr 28 05:56:24 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:24 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-766a021a-aaf0-40ed-ae21-a21c6cc18131 tempest-VolumesCloneTest-1517424155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-829fe991-1d43-4b42-a44f-5858584eaa3f" returned: 0 in 0.460s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:24 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-766a021a-aaf0-40ed-ae21-a21c6cc18131 tempest-VolumesCloneTest-1517424155 None] Lock "cinder-quobyte-829fe991-1d43-4b42-a44f-5858584eaa3f" released by "delete_volume" :: held 1.075s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:56:24 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-766a021a-aaf0-40ed-ae21-a21c6cc18131 tempest-VolumesCloneTest-1517424155 None] Created reservations ['5c9505db-235f-4a4d-bcb7-fecff560da48', 'f04347de-3a6d-4077-95fd-aea640a6b0ab', '55f1e0ca-38d7-4de8-a44e-69951af69ce4', 'bc793719-50fd-4849-a120-cc00a5d8e4b4'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:56:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-766a021a-aaf0-40ed-ae21-a21c6cc18131 tempest-VolumesCloneTest-1517424155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-766a021a-aaf0-40ed-ae21-a21c6cc18131 tempest-VolumesCloneTest-1517424155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:24 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-766a021a-aaf0-40ed-ae21-a21c6cc18131 tempest-VolumesCloneTest-1517424155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:56:24 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-766a021a-aaf0-40ed-ae21-a21c6cc18131 tempest-VolumesCloneTest-1517424155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:56:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-766a021a-aaf0-40ed-ae21-a21c6cc18131 tempest-VolumesCloneTest-1517424155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-766a021a-aaf0-40ed-ae21-a21c6cc18131 tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:24 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:56:24 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:24 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4db11af8-f457-4d98-83a3-53681bcf8e02 tempest-VolumesMetadataTest-67814352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d24522d0-86dc-45bc-a3e8-2f9277cbe66a" returned: 0 in 0.544s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4db11af8-f457-4d98-83a3-53681bcf8e02 tempest-VolumesMetadataTest-67814352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d24522d0-86dc-45bc-a3e8-2f9277cbe66a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:24 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d24522d0-86dc-45bc-a3e8-2f9277cbe66a Apr 28 05:56:24 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:25 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-766a021a-aaf0-40ed-ae21-a21c6cc18131 tempest-VolumesCloneTest-1517424155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.462s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:25 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-766a021a-aaf0-40ed-ae21-a21c6cc18131 tempest-VolumesCloneTest-1517424155 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:56:25 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-766a021a-aaf0-40ed-ae21-a21c6cc18131 tempest-VolumesCloneTest-1517424155 None] Deleted volume successfully. Apr 28 05:56:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-766a021a-aaf0-40ed-ae21-a21c6cc18131 tempest-VolumesCloneTest-1517424155 None] Lock "cinder-829fe991-1d43-4b42-a44f-5858584eaa3f-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:56:25 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4db11af8-f457-4d98-83a3-53681bcf8e02 tempest-VolumesMetadataTest-67814352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d24522d0-86dc-45bc-a3e8-2f9277cbe66a" returned: 0 in 0.455s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4db11af8-f457-4d98-83a3-53681bcf8e02 tempest-VolumesMetadataTest-67814352 None] Lock "cinder-quobyte-d24522d0-86dc-45bc-a3e8-2f9277cbe66a" released by "delete_volume" :: held 1.042s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:56:25 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-4db11af8-f457-4d98-83a3-53681bcf8e02 tempest-VolumesMetadataTest-67814352 None] Created reservations ['31c2978a-2284-4041-b8e2-b8c49e533232', '4424c99d-082b-4962-911d-97240a22fb87', 'd04cdf9e-3dff-4401-a917-e498bf70ee7b', '1ac153b8-f9fe-49b6-97d5-4c7c22ef150d'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:56:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4db11af8-f457-4d98-83a3-53681bcf8e02 tempest-VolumesMetadataTest-67814352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4db11af8-f457-4d98-83a3-53681bcf8e02 tempest-VolumesMetadataTest-67814352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4db11af8-f457-4d98-83a3-53681bcf8e02 tempest-VolumesMetadataTest-67814352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:56:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4db11af8-f457-4d98-83a3-53681bcf8e02 tempest-VolumesMetadataTest-67814352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:56:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4db11af8-f457-4d98-83a3-53681bcf8e02 tempest-VolumesMetadataTest-67814352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4db11af8-f457-4d98-83a3-53681bcf8e02 tempest-VolumesMetadataTest-67814352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:25 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:56:25 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4564bf35-4ebe-46cf-ab63-46f26b71aceb tempest-VolumesCloneTest-1517424155 None] Acquiring lock "cinder-f466fcf9-87e1-4f30-8a50-c5415809688d-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:56:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4564bf35-4ebe-46cf-ab63-46f26b71aceb tempest-VolumesCloneTest-1517424155 None] Lock "cinder-f466fcf9-87e1-4f30-8a50-c5415809688d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:56:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4564bf35-4ebe-46cf-ab63-46f26b71aceb tempest-VolumesCloneTest-1517424155 None] Acquiring lock "cinder-quobyte-f466fcf9-87e1-4f30-8a50-c5415809688d" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:56:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4564bf35-4ebe-46cf-ab63-46f26b71aceb tempest-VolumesCloneTest-1517424155 None] Lock "cinder-quobyte-f466fcf9-87e1-4f30-8a50-c5415809688d" acquired by "delete_volume" :: waited 0.027s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:56:25 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[90669af9-7ece-4a0b-95d2-7dc633d6dd51]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4564bf35-4ebe-46cf-ab63-46f26b71aceb tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:25 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d Apr 28 05:56:25 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:25 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4db11af8-f457-4d98-83a3-53681bcf8e02 tempest-VolumesMetadataTest-67814352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.495s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:25 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-4db11af8-f457-4d98-83a3-53681bcf8e02 tempest-VolumesMetadataTest-67814352 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:56:25 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-4db11af8-f457-4d98-83a3-53681bcf8e02 tempest-VolumesMetadataTest-67814352 None] Deleted volume successfully. Apr 28 05:56:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4db11af8-f457-4d98-83a3-53681bcf8e02 tempest-VolumesMetadataTest-67814352 None] Lock "cinder-d24522d0-86dc-45bc-a3e8-2f9277cbe66a-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:56:26 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4564bf35-4ebe-46cf-ab63-46f26b71aceb tempest-VolumesCloneTest-1517424155 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d" returned: 0 in 0.547s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4564bf35-4ebe-46cf-ab63-46f26b71aceb tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:26 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d Apr 28 05:56:26 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:26 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4564bf35-4ebe-46cf-ab63-46f26b71aceb tempest-VolumesCloneTest-1517424155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f466fcf9-87e1-4f30-8a50-c5415809688d" returned: 0 in 0.486s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4564bf35-4ebe-46cf-ab63-46f26b71aceb tempest-VolumesCloneTest-1517424155 None] Lock "cinder-quobyte-f466fcf9-87e1-4f30-8a50-c5415809688d" released by "delete_volume" :: held 1.088s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:56:26 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-4564bf35-4ebe-46cf-ab63-46f26b71aceb tempest-VolumesCloneTest-1517424155 None] Created reservations ['757bae35-6290-4664-96f2-610e53804cf5', 'b7e824e0-8ea3-49e5-bb2d-ea4b6c09bea1', '05f22c40-8e6d-448e-8cbd-ce838ef7db22', '9ebfaae9-ad57-4e47-a73a-704d79e9ec17'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:56:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4564bf35-4ebe-46cf-ab63-46f26b71aceb tempest-VolumesCloneTest-1517424155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4564bf35-4ebe-46cf-ab63-46f26b71aceb tempest-VolumesCloneTest-1517424155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:27 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4564bf35-4ebe-46cf-ab63-46f26b71aceb tempest-VolumesCloneTest-1517424155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:56:27 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4564bf35-4ebe-46cf-ab63-46f26b71aceb tempest-VolumesCloneTest-1517424155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:56:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4564bf35-4ebe-46cf-ab63-46f26b71aceb tempest-VolumesCloneTest-1517424155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4564bf35-4ebe-46cf-ab63-46f26b71aceb tempest-VolumesCloneTest-1517424155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:27 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:56:27 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:27 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4564bf35-4ebe-46cf-ab63-46f26b71aceb tempest-VolumesCloneTest-1517424155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.482s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:27 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-4564bf35-4ebe-46cf-ab63-46f26b71aceb tempest-VolumesCloneTest-1517424155 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:56:27 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-4564bf35-4ebe-46cf-ab63-46f26b71aceb tempest-VolumesCloneTest-1517424155 None] Deleted volume successfully. Apr 28 05:56:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4564bf35-4ebe-46cf-ab63-46f26b71aceb tempest-VolumesCloneTest-1517424155 None] Lock "cinder-f466fcf9-87e1-4f30-8a50-c5415809688d-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Flow 'volume_create_manager' (c4cb916b-26fb-42e3-a73b-5825cb87b51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44b1b822-f072-46ca-8c30-04f4ea2b59b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44b1b822-f072-46ca-8c30-04f4ea2b59b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-645307948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31dd9fb1-2c6a-4a8c-ae88-088815df54a2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='15598e5c9f2249a38be905d2fede6eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:56:29Z,use_quota=True,user_id='47f36862f6cc4b2f8eb125fb5a62c15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df62561b-7fc7-4f67-a7e1-ca89638639c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df62561b-7fc7-4f67-a7e1-ca89638639c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6d08b0-254a-4b04-8607-051dd8ec4726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6d08b0-254a-4b04-8607-051dd8ec4726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31dd9fb1-2c6a-4a8c-ae88-088815df54a2', 'volume_name': 'volume-31dd9fb1-2c6a-4a8c-ae88-088815df54a2', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50135fe5-8e98-4771-80e0-b282bf201ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50135fe5-8e98-4771-80e0-b282bf201ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78841f2-6389-42c5-b9da-2437d09cfabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:29 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Volume 31dd9fb1-2c6a-4a8c-ae88-088815df54a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31dd9fb1-2c6a-4a8c-ae88-088815df54a2', 'volume_size': 1} Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-645307948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31dd9fb1-2c6a-4a8c-ae88-088815df54a2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='15598e5c9f2249a38be905d2fede6eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:56:29Z,use_quota=True,user_id='47f36862f6cc4b2f8eb125fb5a62c15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Creating volume 31dd9fb1-2c6a-4a8c-ae88-088815df54a2 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:56:29 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-31dd9fb1-2c6a-4a8c-ae88-088815df54a2 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:29 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-31dd9fb1-2c6a-4a8c-ae88-088815df54a2 1073741824 Apr 28 05:56:29 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:29 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-31dd9fb1-2c6a-4a8c-ae88-088815df54a2 1073741824" returned: 0 in 0.660s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-31dd9fb1-2c6a-4a8c-ae88-088815df54a2 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:29 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-31dd9fb1-2c6a-4a8c-ae88-088815df54a2 Apr 28 05:56:29 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:30 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-31dd9fb1-2c6a-4a8c-ae88-088815df54a2" returned: 0 in 0.483s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:56:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78841f2-6389-42c5-b9da-2437d09cfabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31dd9fb1-2c6a-4a8c-ae88-088815df54a2', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9048259e-ee4f-47bb-a3c3-c5a5c3f78211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:30 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Volume volume-31dd9fb1-2c6a-4a8c-ae88-088815df54a2 (31dd9fb1-2c6a-4a8c-ae88-088815df54a2): created successfully Apr 28 05:56:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9048259e-ee4f-47bb-a3c3-c5a5c3f78211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Flow 'volume_create_manager' (c4cb916b-26fb-42e3-a73b-5825cb87b51b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:56:30 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-b193a41d-6254-4d11-9fa8-19a71a8f614b tempest-VolumesGetTest-756263227 None] Created volume successfully. Apr 28 05:56:30 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:56:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Flow 'volume_create_manager' (dea76c54-6724-4d40-954f-516e4f728de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:56:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535aaa55-7b24-461e-9640-59e53e36605a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535aaa55-7b24-461e-9640-59e53e36605a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-371775395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71697aff-258b-4d1c-aa26-339dc8f753f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a4bbce5e8f4757b469b86976c9af7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:56:31Z,use_quota=True,user_id='69bcd01ba3324dcf84d36b440bad4117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabde2f9-552d-42e7-b924-8e3d051cf5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabde2f9-552d-42e7-b924-8e3d051cf5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de90a6fd-4c57-45a5-82d7-9237756bb399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:30 devstack cinder-volume[81829]: DEBUG cinder.image.glance [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Creating Keystone auth plugin from conf {{(pid=81829) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de90a6fd-4c57-45a5-82d7-9237756bb399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '71697aff-258b-4d1c-aa26-339dc8f753f2', 'volume_name': 'volume-71697aff-258b-4d1c-aa26-339dc8f753f2', 'volume_size': 1, 'image_id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe365410c9347328bf4beafdac90830', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'created_at': datetime.datetime(2026, 4, 28, 3, 43, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 3, 43, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25b85b0b-bf76-421a-869b-c686c236a28b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d35385d-a463-4d01-8b63-7b7fa69a2052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d35385d-a463-4d01-8b63-7b7fa69a2052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a95f00-16a9-4cca-b67e-a36c245cc38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:31 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Volume 71697aff-258b-4d1c-aa26-339dc8f753f2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-71697aff-258b-4d1c-aa26-339dc8f753f2', 'volume_size': 1, 'image_id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe365410c9347328bf4beafdac90830', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'created_at': datetime.datetime(2026, 4, 28, 3, 43, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 3, 43, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25b85b0b-bf76-421a-869b-c686c236a28b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Trying to clone 71697aff-258b-4d1c-aa26-339dc8f753f2 from image 25b85b0b-bf76-421a-869b-c686c236a28b at location (None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}]). {{(pid=81829) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7xy8nduwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81829) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 28 05:56:31 devstack cinder-volume[81829]: INFO cinder.image.image_utils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Image download 20.69 MB at 20.69 MB/s Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea3297d-88fa-4a42-aa7e-ca2679025b4a]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7xy8nduwdevstack@QuobyteHD {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:31 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7xy8nduwdevstack@QuobyteHD Apr 28 05:56:31 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Flow 'volume_create_manager' (9d19eb4b-c7b5-4860-8ded-f638cde30744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d6e9b64-ccfd-4023-bae3-c5edce894444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d6e9b64-ccfd-4023-bae3-c5edce894444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:56:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1149569389',display_name='tempest-VolumesGetTest-Volume-1617702280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f47f1b-0613-4d21-a779-182ba303e9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15598e5c9f2249a38be905d2fede6eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:56:32Z,use_quota=True,user_id='47f36862f6cc4b2f8eb125fb5a62c15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aa8a0bf-cb64-4030-8d88-2d4701edf2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aa8a0bf-cb64-4030-8d88-2d4701edf2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b50c90-b950-4408-a9ad-56e398587bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b50c90-b950-4408-a9ad-56e398587bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89f47f1b-0613-4d21-a779-182ba303e9c8', 'volume_name': 'volume-89f47f1b-0613-4d21-a779-182ba303e9c8', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3599d3e4-e040-4a8d-b1dc-a35d542a09f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3599d3e4-e040-4a8d-b1dc-a35d542a09f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3535733-231b-4727-ace6-33662caa0f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:31 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Volume 89f47f1b-0613-4d21-a779-182ba303e9c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89f47f1b-0613-4d21-a779-182ba303e9c8', 'volume_size': 1} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:56:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1149569389',display_name='tempest-VolumesGetTest-Volume-1617702280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f47f1b-0613-4d21-a779-182ba303e9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15598e5c9f2249a38be905d2fede6eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:56:32Z,use_quota=True,user_id='47f36862f6cc4b2f8eb125fb5a62c15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Creating volume 89f47f1b-0613-4d21-a779-182ba303e9c8 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:56:31 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:56:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89f47f1b-0613-4d21-a779-182ba303e9c8 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:31 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89f47f1b-0613-4d21-a779-182ba303e9c8 1073741824 Apr 28 05:56:31 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:32 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7xy8nduwdevstack@QuobyteHD" returned: 0 in 0.563s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:32 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Temporary image 25b85b0b-bf76-421a-869b-c686c236a28b is fetched for user 69bcd01ba3324dcf84d36b440bad4117. {{(pid=81829) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 28 05:56:32 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f66bffb-47f2-43fe-afa8-6edd5f5d1125]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7xy8nduwdevstack@QuobyteHD {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:32 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7xy8nduwdevstack@QuobyteHD Apr 28 05:56:32 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:32 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89f47f1b-0613-4d21-a779-182ba303e9c8 1073741824" returned: 0 in 0.645s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89f47f1b-0613-4d21-a779-182ba303e9c8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:32 devstack sudo[89385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89f47f1b-0613-4d21-a779-182ba303e9c8 Apr 28 05:56:32 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:32 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7xy8nduwdevstack@QuobyteHD" returned: 0 in 0.533s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:32 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89f47f1b-0613-4d21-a779-182ba303e9c8" returned: 0 in 0.452s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:32 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:56:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.352s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:32 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-371775395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71697aff-258b-4d1c-aa26-339dc8f753f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a4bbce5e8f4757b469b86976c9af7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:56:31Z,use_quota=True,user_id='69bcd01ba3324dcf84d36b440bad4117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:56:32 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Creating volume 71697aff-258b-4d1c-aa26-339dc8f753f2 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:56:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:32 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:56:32 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:56:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:32 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:56:32 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:56:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3535733-231b-4727-ace6-33662caa0f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89f47f1b-0613-4d21-a779-182ba303e9c8', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:33 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 1073741824 Apr 28 05:56:33 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1686c50e-02dd-489f-b3fb-f081ed4c23d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:33 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Volume volume-89f47f1b-0613-4d21-a779-182ba303e9c8 (89f47f1b-0613-4d21-a779-182ba303e9c8): created successfully Apr 28 05:56:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1686c50e-02dd-489f-b3fb-f081ed4c23d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:33 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Flow 'volume_create_manager' (9d19eb4b-c7b5-4860-8ded-f638cde30744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:56:33 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-5ff45018-63bb-4e39-a5a1-cccbf95b3953 tempest-VolumesGetTest-756263227 None] Created volume successfully. Apr 28 05:56:33 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 1073741824" returned: 0 in 0.625s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:33 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 Apr 28 05:56:33 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:33 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-45bb4f1e-d600-48ef-9df7-1e3c2c11b019 tempest-VolumesGetTest-756263227 None] Acquiring lock "cinder-89f47f1b-0613-4d21-a779-182ba303e9c8-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:56:33 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-45bb4f1e-d600-48ef-9df7-1e3c2c11b019 tempest-VolumesGetTest-756263227 None] Lock "cinder-89f47f1b-0613-4d21-a779-182ba303e9c8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:56:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-45bb4f1e-d600-48ef-9df7-1e3c2c11b019 tempest-VolumesGetTest-756263227 None] Acquiring lock "cinder-quobyte-89f47f1b-0613-4d21-a779-182ba303e9c8" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:56:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-45bb4f1e-d600-48ef-9df7-1e3c2c11b019 tempest-VolumesGetTest-756263227 None] Lock "cinder-quobyte-89f47f1b-0613-4d21-a779-182ba303e9c8" acquired by "delete_volume" :: waited 0.014s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:56:34 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:34 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[96086405-d3bf-4245-8ecf-1cc4ffd2deb5]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-45bb4f1e-d600-48ef-9df7-1e3c2c11b019 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89f47f1b-0613-4d21-a779-182ba303e9c8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2" returned: 0 in 0.462s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:34 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:56:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:34 devstack cinder-volume[81829]: DEBUG cinder.volume.volume_utils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Attempting download of 25b85b0b-bf76-421a-869b-c686c236a28b ((None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}])) to volume 71697aff-258b-4d1c-aa26-339dc8f753f2. {{(pid=81829) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 28 05:56:34 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[8893ab36-df16-43a9-8521-23a1bafaf285]: (4, 'raw') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_dfhix8sf {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:34 devstack sudo[89399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89f47f1b-0613-4d21-a779-182ba303e9c8 Apr 28 05:56:34 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:34 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_dfhix8sf Apr 28 05:56:34 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:34 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-45bb4f1e-d600-48ef-9df7-1e3c2c11b019 tempest-VolumesGetTest-756263227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89f47f1b-0613-4d21-a779-182ba303e9c8" returned: 0 in 0.535s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-45bb4f1e-d600-48ef-9df7-1e3c2c11b019 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89f47f1b-0613-4d21-a779-182ba303e9c8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:34 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89f47f1b-0613-4d21-a779-182ba303e9c8 Apr 28 05:56:34 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:34 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_dfhix8sf" returned: 0 in 0.481s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_dfhix8sf {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:34 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_dfhix8sf Apr 28 05:56:34 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:35 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-45bb4f1e-d600-48ef-9df7-1e3c2c11b019 tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-89f47f1b-0613-4d21-a779-182ba303e9c8" returned: 0 in 0.476s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:35 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-45bb4f1e-d600-48ef-9df7-1e3c2c11b019 tempest-VolumesGetTest-756263227 None] Lock "cinder-quobyte-89f47f1b-0613-4d21-a779-182ba303e9c8" released by "delete_volume" :: held 1.053s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:56:35 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-45bb4f1e-d600-48ef-9df7-1e3c2c11b019 tempest-VolumesGetTest-756263227 None] Created reservations ['f72ae0e6-b383-451f-9166-cb0d04f80b90', '132cabf0-1d2f-4947-9105-8283cafa0d4d', 'ba4e9ebd-923d-4506-97d6-37bdfc64303c', '87712d64-2cf2-48f1-adf9-9ee8b71e0868'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:56:35 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_dfhix8sf" returned: 1 in 0.517s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_dfhix8sf' failed. Not Retrying. {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 05:56:35 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[74df787d-8bb3-4ca8-b9ea-489a5c241949]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7xy8nduwdevstack@QuobyteHD {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-45bb4f1e-d600-48ef-9df7-1e3c2c11b019 tempest-VolumesGetTest-756263227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-45bb4f1e-d600-48ef-9df7-1e3c2c11b019 tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:35 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-45bb4f1e-d600-48ef-9df7-1e3c2c11b019 tempest-VolumesGetTest-756263227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:56:35 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-45bb4f1e-d600-48ef-9df7-1e3c2c11b019 tempest-VolumesGetTest-756263227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:56:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-45bb4f1e-d600-48ef-9df7-1e3c2c11b019 tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-45bb4f1e-d600-48ef-9df7-1e3c2c11b019 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:35 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7xy8nduwdevstack@QuobyteHD Apr 28 05:56:35 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:35 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:56:35 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:35 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7xy8nduwdevstack@QuobyteHD" returned: 0 in 0.492s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:35 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] 25b85b0b-bf76-421a-869b-c686c236a28b was qcow2, converting to raw {{(pid=81829) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 28 05:56:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7xy8nduwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:35 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-45bb4f1e-d600-48ef-9df7-1e3c2c11b019 tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.452s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:35 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-45bb4f1e-d600-48ef-9df7-1e3c2c11b019 tempest-VolumesGetTest-756263227 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:56:35 devstack sudo[89423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7xy8nduwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 Apr 28 05:56:35 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:35 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-45bb4f1e-d600-48ef-9df7-1e3c2c11b019 tempest-VolumesGetTest-756263227 None] Deleted volume successfully. Apr 28 05:56:35 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-45bb4f1e-d600-48ef-9df7-1e3c2c11b019 tempest-VolumesGetTest-756263227 None] Lock "cinder-89f47f1b-0613-4d21-a779-182ba303e9c8-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:56:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a7552fd7-80f6-42ce-aa67-afe89a76dfbf tempest-VolumesGetTest-756263227 None] Acquiring lock "cinder-31dd9fb1-2c6a-4a8c-ae88-088815df54a2-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:56:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a7552fd7-80f6-42ce-aa67-afe89a76dfbf tempest-VolumesGetTest-756263227 None] Lock "cinder-31dd9fb1-2c6a-4a8c-ae88-088815df54a2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:56:36 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:SELECT=68,cinder:UPDATE=86,cinder:INSERT=24,cinder:DELETE=7 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:56:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a7552fd7-80f6-42ce-aa67-afe89a76dfbf tempest-VolumesGetTest-756263227 None] Acquiring lock "cinder-quobyte-31dd9fb1-2c6a-4a8c-ae88-088815df54a2" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:56:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a7552fd7-80f6-42ce-aa67-afe89a76dfbf tempest-VolumesGetTest-756263227 None] Lock "cinder-quobyte-31dd9fb1-2c6a-4a8c-ae88-088815df54a2" acquired by "delete_volume" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:56:36 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fce323-fe67-4bdd-8c49-0a2ce129277f]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7552fd7-80f6-42ce-aa67-afe89a76dfbf tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-31dd9fb1-2c6a-4a8c-ae88-088815df54a2 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:36 devstack sudo[89432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-31dd9fb1-2c6a-4a8c-ae88-088815df54a2 Apr 28 05:56:36 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:37 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:37 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7552fd7-80f6-42ce-aa67-afe89a76dfbf tempest-VolumesGetTest-756263227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-31dd9fb1-2c6a-4a8c-ae88-088815df54a2" returned: 0 in 0.629s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7552fd7-80f6-42ce-aa67-afe89a76dfbf tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-31dd9fb1-2c6a-4a8c-ae88-088815df54a2 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7xy8nduwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2" returned: 0 in 1.364s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:37 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7xy8nduwdevstack@QuobyteHD, size 112.00 MB, duration 1.37 sec, destination /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 {{(pid=81829) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:56:37 devstack cinder-volume[81829]: INFO cinder.image.image_utils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Converted 112.00 MB image at 81.93 MB/s Apr 28 05:56:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:37 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-31dd9fb1-2c6a-4a8c-ae88-088815df54a2 Apr 28 05:56:37 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:37 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 1G Apr 28 05:56:37 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:37 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7552fd7-80f6-42ce-aa67-afe89a76dfbf tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-31dd9fb1-2c6a-4a8c-ae88-088815df54a2" returned: 0 in 0.448s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a7552fd7-80f6-42ce-aa67-afe89a76dfbf tempest-VolumesGetTest-756263227 None] Lock "cinder-quobyte-31dd9fb1-2c6a-4a8c-ae88-088815df54a2" released by "delete_volume" :: held 1.121s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:56:37 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-a7552fd7-80f6-42ce-aa67-afe89a76dfbf tempest-VolumesGetTest-756263227 None] Created reservations ['fd3e626b-2d7b-44f8-821a-174a3ce7d7b5', '2a019b50-3f20-4cb0-92d3-dc540554643e', '073b4e15-cbc5-4aac-b027-8011023210a3', 'df0747c5-3ade-452b-a3ff-6d65cf6454d0'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:56:37 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 1G" returned: 0 in 0.520s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a7552fd7-80f6-42ce-aa67-afe89a76dfbf tempest-VolumesGetTest-756263227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a7552fd7-80f6-42ce-aa67-afe89a76dfbf tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:37 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a7552fd7-80f6-42ce-aa67-afe89a76dfbf tempest-VolumesGetTest-756263227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:56:37 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a7552fd7-80f6-42ce-aa67-afe89a76dfbf tempest-VolumesGetTest-756263227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:56:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a7552fd7-80f6-42ce-aa67-afe89a76dfbf tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7552fd7-80f6-42ce-aa67-afe89a76dfbf tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:37 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c593fb-f95d-44e6-af0c-779099847313]: (4, 'raw') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:37 devstack sudo[89445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:56:37 devstack sudo[89445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:37 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 Apr 28 05:56:37 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:38 devstack sudo[89445]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a7552fd7-80f6-42ce-aa67-afe89a76dfbf tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.450s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-a7552fd7-80f6-42ce-aa67-afe89a76dfbf tempest-VolumesGetTest-756263227 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:56:38 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-a7552fd7-80f6-42ce-aa67-afe89a76dfbf tempest-VolumesGetTest-756263227 None] Deleted volume successfully. Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a7552fd7-80f6-42ce-aa67-afe89a76dfbf tempest-VolumesGetTest-756263227 None] Lock "cinder-31dd9fb1-2c6a-4a8c-ae88-088815df54a2-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:56:38 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2" returned: 0 in 0.534s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:38 devstack sudo[89452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 Apr 28 05:56:38 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:38 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2" returned: 1 in 0.534s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2' failed. Not Retrying. {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.volume_utils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Downloaded image 25b85b0b-bf76-421a-869b-c686c236a28b ((None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}])) to volume 71697aff-258b-4d1c-aa26-339dc8f753f2 successfully. {{(pid=81829) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Temporary image 25b85b0b-bf76-421a-869b-c686c236a28b for user 69bcd01ba3324dcf84d36b440bad4117 is deleted. {{(pid=81829) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.volume_utils [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Marking volume 71697aff-258b-4d1c-aa26-339dc8f753f2 as bootable. {{(pid=81829) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Copying metadata from image 25b85b0b-bf76-421a-869b-c686c236a28b to 71697aff-258b-4d1c-aa26-339dc8f753f2. {{(pid=81829) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Creating volume glance metadata for volume 71697aff-258b-4d1c-aa26-339dc8f753f2 backed by image 25b85b0b-bf76-421a-869b-c686c236a28b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81829) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a95f00-16a9-4cca-b67e-a36c245cc38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71697aff-258b-4d1c-aa26-339dc8f753f2', 'volume_size': 1, 'image_id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe365410c9347328bf4beafdac90830', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'created_at': datetime.datetime(2026, 4, 28, 3, 43, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 3, 43, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25b85b0b-bf76-421a-869b-c686c236a28b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6d1dd4-bc48-4eeb-b427-5b14806df2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:38 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Volume volume-71697aff-258b-4d1c-aa26-339dc8f753f2 (71697aff-258b-4d1c-aa26-339dc8f753f2): created successfully Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6d1dd4-bc48-4eeb-b427-5b14806df2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Flow 'volume_create_manager' (dea76c54-6724-4d40-954f-516e4f728de6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:56:38 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-42d7d232-6ed1-4f63-bee0-c04f8c707506 tempest-VolumesExtendTest-1542751612 None] Created volume successfully. Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Flow 'volume_create_manager' (069b25c6-a593-49a1-a47e-6e9a125ac997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679bc656-5fa4-4820-80fc-85648d6cb6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679bc656-5fa4-4820-80fc-85648d6cb6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-854143541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63911a0e-cee7-4adf-b05a-23af5cc50cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15598e5c9f2249a38be905d2fede6eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:56:39Z,use_quota=True,user_id='47f36862f6cc4b2f8eb125fb5a62c15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1263ee08-c63f-44ab-a049-7a3cc3d71837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1263ee08-c63f-44ab-a049-7a3cc3d71837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6647941-04cb-4869-affe-89673d031f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6647941-04cb-4869-affe-89673d031f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63911a0e-cee7-4adf-b05a-23af5cc50cc2', 'volume_name': 'volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (897aa363-8e5a-47b1-98a6-2c399586503c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (897aa363-8e5a-47b1-98a6-2c399586503c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b193bf8-a4bc-47f3-8903-c58ad9ceb28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:38 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Volume 63911a0e-cee7-4adf-b05a-23af5cc50cc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2', 'volume_size': 1} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-854143541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63911a0e-cee7-4adf-b05a-23af5cc50cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15598e5c9f2249a38be905d2fede6eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:56:39Z,use_quota=True,user_id='47f36862f6cc4b2f8eb125fb5a62c15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Creating volume 63911a0e-cee7-4adf-b05a-23af5cc50cc2 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:56:38 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:56:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:38 devstack sudo[89457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 1073741824 Apr 28 05:56:38 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3c465a3d-78e2-4636-baa3-cb09f64fe7b7 tempest-VolumesExtendTest-1542751612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:39 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 1073741824" returned: 0 in 0.623s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:39 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 Apr 28 05:56:39 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:40 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2" returned: 0 in 0.459s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:56:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3c465a3d-78e2-4636-baa3-cb09f64fe7b7 tempest-VolumesExtendTest-1542751612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.683s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b193bf8-a4bc-47f3-8903-c58ad9ceb28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03721da4-b971-410d-b3f6-3df83cfe42c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:40 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Volume volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 (63911a0e-cee7-4adf-b05a-23af5cc50cc2): created successfully Apr 28 05:56:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03721da4-b971-410d-b3f6-3df83cfe42c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Flow 'volume_create_manager' (069b25c6-a593-49a1-a47e-6e9a125ac997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:56:40 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4999c7b-51b0-4284-9f54-106678a755d0]: (4, 'raw') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3c465a3d-78e2-4636-baa3-cb09f64fe7b7 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:40 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-5f3c0f80-53d5-4f60-a63e-f9a2adfc5bd5 tempest-VolumesGetTest-756263227 None] Created volume successfully. Apr 28 05:56:40 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 Apr 28 05:56:40 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:40 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3c465a3d-78e2-4636-baa3-cb09f64fe7b7 tempest-VolumesExtendTest-1542751612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2" returned: 0 in 0.519s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3c465a3d-78e2-4636-baa3-cb09f64fe7b7 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:40 devstack sudo[89469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 Apr 28 05:56:40 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:41 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3c465a3d-78e2-4636-baa3-cb09f64fe7b7 tempest-VolumesExtendTest-1542751612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2" returned: 1 in 0.545s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3c465a3d-78e2-4636-baa3-cb09f64fe7b7 tempest-VolumesExtendTest-1542751612 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2' failed. Not Retrying. {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3c465a3d-78e2-4636-baa3-cb09f64fe7b7 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 2G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3c465a3d-78e2-4636-baa3-cb09f64fe7b7 tempest-VolumesExtendTest-1542751612 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 2G" returned: 0 in 0.068s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3c465a3d-78e2-4636-baa3-cb09f64fe7b7 tempest-VolumesExtendTest-1542751612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.181s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:41 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-3c465a3d-78e2-4636-baa3-cb09f64fe7b7 tempest-VolumesExtendTest-1542751612 None] Extend volume completed successfully. Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:UPDATE=95,cinder:SELECT=73,cinder:INSERT=35,cinder:DELETE=9 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Flow 'volume_create_manager' (7e6f5764-b34a-4826-8a2c-0e99a605634f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3c02b6-6bb5-4e3b-8dc7-df0a9632230e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3c02b6-6bb5-4e3b-8dc7-df0a9632230e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1772986587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7ad9c8-a4bb-4910-a89a-8a0359997db3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='15598e5c9f2249a38be905d2fede6eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=63911a0e-cee7-4adf-b05a-23af5cc50cc2,status='creating',terminated_at=None,updated_at=2026-04-28T03:56:41Z,use_quota=True,user_id='47f36862f6cc4b2f8eb125fb5a62c15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7800d05c-1e84-4fc3-be2a-215f1092a73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7800d05c-1e84-4fc3-be2a-215f1092a73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (630fe437-689c-4875-bdff-5be67c067a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (630fe437-689c-4875-bdff-5be67c067a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5e7ad9c8-a4bb-4910-a89a-8a0359997db3', 'volume_name': 'volume-5e7ad9c8-a4bb-4910-a89a-8a0359997db3', 'volume_size': 1, 'source_volid': '63911a0e-cee7-4adf-b05a-23af5cc50cc2', 'source_volstatus': 'available'}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67d1b87-b9d4-432c-a232-bc0eaf72deb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67d1b87-b9d4-432c-a232-bc0eaf72deb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ccf9d3-e117-44ce-9283-45e71dd237df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:41 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Volume 5e7ad9c8-a4bb-4910-a89a-8a0359997db3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5e7ad9c8-a4bb-4910-a89a-8a0359997db3', 'volume_size': 1, 'source_volid': '63911a0e-cee7-4adf-b05a-23af5cc50cc2', 'source_volstatus': 'available'} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:41 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Cloning volume 63911a0e-cee7-4adf-b05a-23af5cc50cc2 to volume 5e7ad9c8-a4bb-4910-a89a-8a0359997db3 Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Creating offline snapshot 430e90e8-e8f2-45a3-8c07-b6b09b1263f0 of volume 63911a0e-cee7-4adf-b05a-23af5cc50cc2 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27a2b55-9e69-44a1-aac4-a2fff28339c7]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:41 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 Apr 28 05:56:41 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] Acquiring lock "cinder-71697aff-258b-4d1c-aa26-339dc8f753f2-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] Lock "cinder-71697aff-258b-4d1c-aa26-339dc8f753f2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] Acquiring lock "cinder-quobyte-71697aff-258b-4d1c-aa26-339dc8f753f2" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] Lock "cinder-quobyte-71697aff-258b-4d1c-aa26-339dc8f753f2" acquired by "delete_volume" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d3e6bb-5f89-4f6a-98c9-4e43cd52cfbf]: (4, 'raw') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:41 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 Apr 28 05:56:41 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:42 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2" returned: 0 in 0.549s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:42 devstack sudo[89485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0 1G Apr 28 05:56:42 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:42 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2" returned: 0 in 0.531s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:42 devstack sudo[89489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 Apr 28 05:56:42 devstack sudo[89489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:42 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0 1G" returned: 0 in 0.647s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:42 devstack sudo[89494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0 Apr 28 05:56:42 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:42 devstack sudo[89489]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2" returned: 1 in 0.554s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2' failed. Not Retrying. {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 05:56:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:42 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2 Apr 28 05:56:42 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:43 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0" returned: 0 in 0.497s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:43 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0 is being set with open permissions: ugo+rw Apr 28 05:56:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:43 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0 Apr 28 05:56:43 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:43 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71697aff-258b-4d1c-aa26-339dc8f753f2" returned: 0 in 0.455s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:43 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] Lock "cinder-quobyte-71697aff-258b-4d1c-aa26-339dc8f753f2" released by "delete_volume" :: held 1.611s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:56:43 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] Created reservations ['a164675b-8c6c-47af-a26a-dedc274a7bce', '64eec891-1be1-4441-abe6-25a766e35766', '96621498-5616-4ae6-8e67-7b8bc47bc747', 'ee950f19-429e-411a-8f24-be01309a4c63'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:56:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:43 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:56:43 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:56:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:43 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:56:43 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:43 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0" returned: 0 in 0.478s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:43 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.info Apr 28 05:56:43 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:43 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.443s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:43 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:56:43 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] Deleted volume successfully. Apr 28 05:56:43 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cc64c363-f002-41c7-b709-4d868896a4d8 tempest-VolumesExtendTest-1542751612 None] Lock "cinder-71697aff-258b-4d1c-aa26-339dc8f753f2-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Flow 'volume_create_manager' (b76db857-4fe4-41bb-b07a-ddb8866ccde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc947a01-79a5-4444-9b2c-486ab8d76ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:44 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.info" returned: 0 in 0.520s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:44 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.info is being set with open permissions: ugo+rw Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc947a01-79a5-4444-9b2c-486ab8d76ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-994612153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a4bbce5e8f4757b469b86976c9af7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:56:44Z,use_quota=True,user_id='69bcd01ba3324dcf84d36b440bad4117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfdb57e8-619f-4ed9-911f-3acbb740af92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:44 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.info Apr 28 05:56:44 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfdb57e8-619f-4ed9-911f-3acbb740af92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1afc72b9-a221-4702-804a-e99043bc0019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1afc72b9-a221-4702-804a-e99043bc0019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c', 'volume_name': 'volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2686f92-2c15-42ee-9e14-de8750732b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2686f92-2c15-42ee-9e14-de8750732b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235e8af4-3719-4d3f-afea-0b8deae8d153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:44 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Volume e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c', 'volume_size': 1} Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:44 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.info" returned: 0 in 0.433s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Acquiring lock "cinder-quobyte-5e7ad9c8-a4bb-4910-a89a-8a0359997db3" by "_copy_volume_from_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Lock "cinder-quobyte-5e7ad9c8-a4bb-4910-a89a-8a0359997db3" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] snapshot: 430e90e8-e8f2-45a3-8c07-b6b09b1263f0, volume: 5e7ad9c8-a4bb-4910-a89a-8a0359997db3, {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[142c91b6-a68a-416f-944b-7124cfb511b8]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:44 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0 Apr 28 05:56:44 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:45 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0" returned: 0 in 0.522s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:45 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:56:45 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] will copy from snapshot at /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 05:56:45 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Creating direct copy from snapshot {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 05:56:45 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f1dd30-6de8-44b8-8de3-6b4286681a28]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:45 devstack sudo[89522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 Apr 28 05:56:45 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:45 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2" returned: 0 in 0.515s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:45 devstack cinder-volume[81829]: DEBUG cinder.utils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Path /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5e7ad9c8-a4bb-4910-a89a-8a0359997db3 not found in is_blk_device check {{(pid=81829) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 05:56:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5e7ad9c8-a4bb-4910-a89a-8a0359997db3 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:45 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5e7ad9c8-a4bb-4910-a89a-8a0359997db3 Apr 28 05:56:45 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:50 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5e7ad9c8-a4bb-4910-a89a-8a0359997db3" returned: 0 in 4.630s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:50 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4bf071-3396-4643-b32b-c89404513f77]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:50 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 Apr 28 05:56:50 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:51 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2" returned: 0 in 0.661s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:51 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Image conversion details: src /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2, size 1024.00 MB, duration 4.63 sec, destination /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5e7ad9c8-a4bb-4910-a89a-8a0359997db3 {{(pid=81829) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:56:51 devstack cinder-volume[81829]: INFO cinder.image.image_utils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Converted 1024.00 MB image at 221.11 MB/s Apr 28 05:56:51 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5e7ad9c8-a4bb-4910-a89a-8a0359997db3 is being set with open permissions: ugo+rw Apr 28 05:56:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5e7ad9c8-a4bb-4910-a89a-8a0359997db3 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:51 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5e7ad9c8-a4bb-4910-a89a-8a0359997db3 Apr 28 05:56:51 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:51 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5e7ad9c8-a4bb-4910-a89a-8a0359997db3" returned: 0 in 0.444s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:51 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Lock "cinder-quobyte-5e7ad9c8-a4bb-4910-a89a-8a0359997db3" released by "_copy_volume_from_snapshot" :: held 6.847s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:56:51 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Acquiring lock "cinder-quobyte-430e90e8-e8f2-45a3-8c07-b6b09b1263f0" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:56:51 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Lock "cinder-quobyte-430e90e8-e8f2-45a3-8c07-b6b09b1263f0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:56:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Deleting offline snapshot 430e90e8-e8f2-45a3-8c07-b6b09b1263f0 of volume 63911a0e-cee7-4adf-b05a-23af5cc50cc2 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:56:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] snapshot_file for this snap is: volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:56:51 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[496347be-336e-45a8-a141-c3ca36743591]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:51 devstack sudo[89548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0 Apr 28 05:56:51 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:52 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0" returned: 0 in 0.516s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:56:52 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[53323b73-bbb1-4615-825c-02e8f5e0ba2c]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:52 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 Apr 28 05:56:52 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:52 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2" returned: 0 in 0.527s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:52 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0 Apr 28 05:56:52 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:53 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0" returned: 0 in 0.534s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:53 devstack sudo[89569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0 Apr 28 05:56:53 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:53 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2.430e90e8-e8f2-45a3-8c07-b6b09b1263f0" returned: 0 in 0.444s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:53 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Lock "cinder-quobyte-430e90e8-e8f2-45a3-8c07-b6b09b1263f0" released by "_delete_snapshot" :: held 2.109s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:56:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.260s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.439s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:53 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-994612153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a4bbce5e8f4757b469b86976c9af7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:56:44Z,use_quota=True,user_id='69bcd01ba3324dcf84d36b440bad4117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:56:53 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Creating volume e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:56:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:53 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:56:53 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:56:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:53 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:56:53 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:56:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:53 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ccf9d3-e117-44ce-9283-45e71dd237df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e7ad9c8-a4bb-4910-a89a-8a0359997db3', 'volume_size': 1, 'source_volid': '63911a0e-cee7-4adf-b05a-23af5cc50cc2', 'source_volstatus': 'available'}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:53 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acfa8d5-2cdc-491a-b323-befee6aaaef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:53 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c 1073741824 Apr 28 05:56:53 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:53 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Volume volume-5e7ad9c8-a4bb-4910-a89a-8a0359997db3 (5e7ad9c8-a4bb-4910-a89a-8a0359997db3): created successfully Apr 28 05:56:53 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acfa8d5-2cdc-491a-b323-befee6aaaef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:53 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Flow 'volume_create_manager' (7e6f5764-b34a-4826-8a2c-0e99a605634f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:56:53 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-faf8f9dc-bd21-43ed-b2bb-59c3be3cd03b tempest-VolumesGetTest-756263227 None] Created volume successfully. Apr 28 05:56:54 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c 1073741824" returned: 0 in 0.627s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:54 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c Apr 28 05:56:54 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Flow 'volume_create_manager' (9155e3e4-36c1-4d20-b125-3ec7a6290db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35be5b20-c63e-42e4-af23-c0f1cd82e075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35be5b20-c63e-42e4-af23-c0f1cd82e075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:56:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-337706231',display_name='tempest-VolumesGetTest-Volume-1312154783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c6cd88-1cae-4991-925c-d017488425a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15598e5c9f2249a38be905d2fede6eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:56:55Z,use_quota=True,user_id='47f36862f6cc4b2f8eb125fb5a62c15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e651d8cf-a324-41a5-be25-9b63b690c25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e651d8cf-a324-41a5-be25-9b63b690c25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4bb163a-fdc8-45db-9cba-629e79114cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4bb163a-fdc8-45db-9cba-629e79114cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14c6cd88-1cae-4991-925c-d017488425a1', 'volume_name': 'volume-14c6cd88-1cae-4991-925c-d017488425a1', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:54 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ec751e-3346-48a3-9533-9f5741f391f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ec751e-3346-48a3-9533-9f5741f391f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf80e91-9095-4f6c-9b6f-bef0455ebf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:54 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Volume 14c6cd88-1cae-4991-925c-d017488425a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14c6cd88-1cae-4991-925c-d017488425a1', 'volume_size': 1} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c" returned: 0 in 0.490s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:56:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-337706231',display_name='tempest-VolumesGetTest-Volume-1312154783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c6cd88-1cae-4991-925c-d017488425a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15598e5c9f2249a38be905d2fede6eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:56:55Z,use_quota=True,user_id='47f36862f6cc4b2f8eb125fb5a62c15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Creating volume 14c6cd88-1cae-4991-925c-d017488425a1 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:56:54 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-14c6cd88-1cae-4991-925c-d017488425a1 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:54 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-14c6cd88-1cae-4991-925c-d017488425a1 1073741824 Apr 28 05:56:54 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235e8af4-3719-4d3f-afea-0b8deae8d153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f8925d-c442-4fcb-a5c6-37df0c37c428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:54 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Volume volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c (e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c): created successfully Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f8925d-c442-4fcb-a5c6-37df0c37c428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:54 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Flow 'volume_create_manager' (b76db857-4fe4-41bb-b07a-ddb8866ccde8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:56:55 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-6501151e-9ddc-450c-aa4e-c39d854043ac tempest-VolumesExtendTest-1542751612 None] Created volume successfully. Apr 28 05:56:55 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-14c6cd88-1cae-4991-925c-d017488425a1 1073741824" returned: 0 in 0.596s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-14c6cd88-1cae-4991-925c-d017488425a1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:55 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-14c6cd88-1cae-4991-925c-d017488425a1 Apr 28 05:56:55 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:56 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-14c6cd88-1cae-4991-925c-d017488425a1" returned: 0 in 0.466s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:56 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:56:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:56 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf80e91-9095-4f6c-9b6f-bef0455ebf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14c6cd88-1cae-4991-925c-d017488425a1', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:56 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0340a2e5-f79c-45c6-a834-3bb3bc98c568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:56:56 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Volume volume-14c6cd88-1cae-4991-925c-d017488425a1 (14c6cd88-1cae-4991-925c-d017488425a1): created successfully Apr 28 05:56:56 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0340a2e5-f79c-45c6-a834-3bb3bc98c568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:56:56 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Flow 'volume_create_manager' (9155e3e4-36c1-4d20-b125-3ec7a6290db0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:56:56 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-5c417ffc-7a6f-4db3-94d1-061f41988086 tempest-VolumesGetTest-756263227 None] Created volume successfully. Apr 28 05:56:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-691ecd98-dd47-49df-aa5e-1a87281d3d20 tempest-VolumesExtendTest-1542751612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-691ecd98-dd47-49df-aa5e-1a87281d3d20 tempest-VolumesExtendTest-1542751612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:56 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-691ecd98-dd47-49df-aa5e-1a87281d3d20 tempest-VolumesExtendTest-1542751612 None] Creating offline snapshot ff30571f-556b-416b-813f-de61fee021a0 of volume e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:56:56 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61f6e73-4d3b-4aa5-b263-99a6e12ebf0b]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-691ecd98-dd47-49df-aa5e-1a87281d3d20 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:56 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c Apr 28 05:56:56 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:56 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-691ecd98-dd47-49df-aa5e-1a87281d3d20 tempest-VolumesExtendTest-1542751612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c" returned: 0 in 0.508s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-691ecd98-dd47-49df-aa5e-1a87281d3d20 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.ff30571f-556b-416b-813f-de61fee021a0 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:56 devstack sudo[89593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.ff30571f-556b-416b-813f-de61fee021a0 1G Apr 28 05:56:56 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6e89c79a-5d0b-4e43-9601-10821bef3bf4 tempest-VolumesGetTest-756263227 None] Acquiring lock "cinder-14c6cd88-1cae-4991-925c-d017488425a1-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:56:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6e89c79a-5d0b-4e43-9601-10821bef3bf4 tempest-VolumesGetTest-756263227 None] Lock "cinder-14c6cd88-1cae-4991-925c-d017488425a1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:56:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6e89c79a-5d0b-4e43-9601-10821bef3bf4 tempest-VolumesGetTest-756263227 None] Acquiring lock "cinder-quobyte-14c6cd88-1cae-4991-925c-d017488425a1" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:56:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6e89c79a-5d0b-4e43-9601-10821bef3bf4 tempest-VolumesGetTest-756263227 None] Lock "cinder-quobyte-14c6cd88-1cae-4991-925c-d017488425a1" acquired by "delete_volume" :: waited 0.028s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:56:57 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[884731b0-4bcd-4e3d-aed6-14576afd5f6d]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6e89c79a-5d0b-4e43-9601-10821bef3bf4 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-14c6cd88-1cae-4991-925c-d017488425a1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:57 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-14c6cd88-1cae-4991-925c-d017488425a1 Apr 28 05:56:57 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:57 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-691ecd98-dd47-49df-aa5e-1a87281d3d20 tempest-VolumesExtendTest-1542751612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.ff30571f-556b-416b-813f-de61fee021a0 1G" returned: 0 in 0.658s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-691ecd98-dd47-49df-aa5e-1a87281d3d20 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.ff30571f-556b-416b-813f-de61fee021a0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:57 devstack sudo[89600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.ff30571f-556b-416b-813f-de61fee021a0 Apr 28 05:56:57 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:57 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6e89c79a-5d0b-4e43-9601-10821bef3bf4 tempest-VolumesGetTest-756263227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-14c6cd88-1cae-4991-925c-d017488425a1" returned: 0 in 0.557s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6e89c79a-5d0b-4e43-9601-10821bef3bf4 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-14c6cd88-1cae-4991-925c-d017488425a1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:57 devstack sudo[89608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-14c6cd88-1cae-4991-925c-d017488425a1 Apr 28 05:56:57 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:57 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-691ecd98-dd47-49df-aa5e-1a87281d3d20 tempest-VolumesExtendTest-1542751612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.ff30571f-556b-416b-813f-de61fee021a0" returned: 0 in 0.485s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:57 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-691ecd98-dd47-49df-aa5e-1a87281d3d20 tempest-VolumesExtendTest-1542751612 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.ff30571f-556b-416b-813f-de61fee021a0 is being set with open permissions: ugo+rw Apr 28 05:56:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-691ecd98-dd47-49df-aa5e-1a87281d3d20 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.ff30571f-556b-416b-813f-de61fee021a0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:57 devstack sudo[89610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.ff30571f-556b-416b-813f-de61fee021a0 Apr 28 05:56:57 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:58 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6e89c79a-5d0b-4e43-9601-10821bef3bf4 tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-14c6cd88-1cae-4991-925c-d017488425a1" returned: 0 in 0.478s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6e89c79a-5d0b-4e43-9601-10821bef3bf4 tempest-VolumesGetTest-756263227 None] Lock "cinder-quobyte-14c6cd88-1cae-4991-925c-d017488425a1" released by "delete_volume" :: held 1.081s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:56:58 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-6e89c79a-5d0b-4e43-9601-10821bef3bf4 tempest-VolumesGetTest-756263227 None] Created reservations ['b94463fc-8d21-42df-91e8-ac75103ef3ba', '625a9f0c-9180-4988-944e-e0400b2f35fb', 'fadbf926-ef3a-4b6b-95aa-c9bfdfdae485', '8b64afa3-0d30-4c36-a782-61f53104fdac'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:56:58 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-691ecd98-dd47-49df-aa5e-1a87281d3d20 tempest-VolumesExtendTest-1542751612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.ff30571f-556b-416b-813f-de61fee021a0" returned: 0 in 0.482s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-691ecd98-dd47-49df-aa5e-1a87281d3d20 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6e89c79a-5d0b-4e43-9601-10821bef3bf4 tempest-VolumesGetTest-756263227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:56:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6e89c79a-5d0b-4e43-9601-10821bef3bf4 tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:56:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6e89c79a-5d0b-4e43-9601-10821bef3bf4 tempest-VolumesGetTest-756263227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:56:58 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.info Apr 28 05:56:58 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6e89c79a-5d0b-4e43-9601-10821bef3bf4 tempest-VolumesGetTest-756263227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:56:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6e89c79a-5d0b-4e43-9601-10821bef3bf4 tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6e89c79a-5d0b-4e43-9601-10821bef3bf4 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:58 devstack sudo[89616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:56:58 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:58 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-691ecd98-dd47-49df-aa5e-1a87281d3d20 tempest-VolumesExtendTest-1542751612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.info" returned: 0 in 0.489s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:58 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-691ecd98-dd47-49df-aa5e-1a87281d3d20 tempest-VolumesExtendTest-1542751612 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.info is being set with open permissions: ugo+rw Apr 28 05:56:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-691ecd98-dd47-49df-aa5e-1a87281d3d20 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:58 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6e89c79a-5d0b-4e43-9601-10821bef3bf4 tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.462s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:58 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-6e89c79a-5d0b-4e43-9601-10821bef3bf4 tempest-VolumesGetTest-756263227 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:56:58 devstack sudo[89621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.info Apr 28 05:56:58 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:56:58 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-6e89c79a-5d0b-4e43-9601-10821bef3bf4 tempest-VolumesGetTest-756263227 None] Deleted volume successfully. Apr 28 05:56:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6e89c79a-5d0b-4e43-9601-10821bef3bf4 tempest-VolumesGetTest-756263227 None] Lock "cinder-14c6cd88-1cae-4991-925c-d017488425a1-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:56:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-95f8a533-ff54-4011-a460-b4706baf8ee5 tempest-VolumesGetTest-756263227 None] Acquiring lock "cinder-5e7ad9c8-a4bb-4910-a89a-8a0359997db3-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:56:59 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root Apr 28 05:56:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-691ecd98-dd47-49df-aa5e-1a87281d3d20 tempest-VolumesExtendTest-1542751612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.info" returned: 0 in 0.506s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:56:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-691ecd98-dd47-49df-aa5e-1a87281d3d20 tempest-VolumesExtendTest-1542751612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.231s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:56:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-95f8a533-ff54-4011-a460-b4706baf8ee5 tempest-VolumesGetTest-756263227 None] Lock "cinder-5e7ad9c8-a4bb-4910-a89a-8a0359997db3-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:56:59 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-691ecd98-dd47-49df-aa5e-1a87281d3d20 tempest-VolumesExtendTest-1542751612 None] Create snapshot completed successfully Apr 28 05:56:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-95f8a533-ff54-4011-a460-b4706baf8ee5 tempest-VolumesGetTest-756263227 None] Acquiring lock "cinder-quobyte-5e7ad9c8-a4bb-4910-a89a-8a0359997db3" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:56:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-95f8a533-ff54-4011-a460-b4706baf8ee5 tempest-VolumesGetTest-756263227 None] Lock "cinder-quobyte-5e7ad9c8-a4bb-4910-a89a-8a0359997db3" acquired by "delete_volume" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:56:59 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a7b629-1b73-44e7-a820-79f1869bfb73]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:56:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-95f8a533-ff54-4011-a460-b4706baf8ee5 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5e7ad9c8-a4bb-4910-a89a-8a0359997db3 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:56:59 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5e7ad9c8-a4bb-4910-a89a-8a0359997db3 Apr 28 05:56:59 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:00 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-95f8a533-ff54-4011-a460-b4706baf8ee5 tempest-VolumesGetTest-756263227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5e7ad9c8-a4bb-4910-a89a-8a0359997db3" returned: 0 in 0.554s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-95f8a533-ff54-4011-a460-b4706baf8ee5 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5e7ad9c8-a4bb-4910-a89a-8a0359997db3 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:00 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5e7ad9c8-a4bb-4910-a89a-8a0359997db3 Apr 28 05:57:00 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d9126046-fdc5-4322-8141-73e02a9b1dda tempest-VolumesExtendTest-1542751612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d9126046-fdc5-4322-8141-73e02a9b1dda tempest-VolumesExtendTest-1542751612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:00 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9e5b2d-576b-4dc9-8b7d-951f18e02fb9]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d9126046-fdc5-4322-8141-73e02a9b1dda tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:00 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-95f8a533-ff54-4011-a460-b4706baf8ee5 tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5e7ad9c8-a4bb-4910-a89a-8a0359997db3" returned: 0 in 0.477s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:00 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-95f8a533-ff54-4011-a460-b4706baf8ee5 tempest-VolumesGetTest-756263227 None] Lock "cinder-quobyte-5e7ad9c8-a4bb-4910-a89a-8a0359997db3" released by "delete_volume" :: held 1.076s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:00 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c Apr 28 05:57:00 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:00 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-95f8a533-ff54-4011-a460-b4706baf8ee5 tempest-VolumesGetTest-756263227 None] Created reservations ['cbb3e1b0-2898-4655-b7fe-32a1129b3f8c', 'e291786a-d855-4ec4-acf3-596204f83126', '9eddf82c-fdb9-45c7-9224-f2756fe371cb', '76b71165-db65-4e78-a9ad-598db9fa700d'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:57:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-95f8a533-ff54-4011-a460-b4706baf8ee5 tempest-VolumesGetTest-756263227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-95f8a533-ff54-4011-a460-b4706baf8ee5 tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:00 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-95f8a533-ff54-4011-a460-b4706baf8ee5 tempest-VolumesGetTest-756263227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:00 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-95f8a533-ff54-4011-a460-b4706baf8ee5 tempest-VolumesGetTest-756263227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-95f8a533-ff54-4011-a460-b4706baf8ee5 tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-95f8a533-ff54-4011-a460-b4706baf8ee5 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:00 devstack sudo[89634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:57:00 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:01 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d9126046-fdc5-4322-8141-73e02a9b1dda tempest-VolumesExtendTest-1542751612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c" returned: 0 in 0.586s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d9126046-fdc5-4322-8141-73e02a9b1dda tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.ff30571f-556b-416b-813f-de61fee021a0 2G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:01 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-95f8a533-ff54-4011-a460-b4706baf8ee5 tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.468s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-95f8a533-ff54-4011-a460-b4706baf8ee5 tempest-VolumesGetTest-756263227 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:57:01 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-95f8a533-ff54-4011-a460-b4706baf8ee5 tempest-VolumesGetTest-756263227 None] Deleted volume successfully. Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-95f8a533-ff54-4011-a460-b4706baf8ee5 tempest-VolumesGetTest-756263227 None] Lock "cinder-5e7ad9c8-a4bb-4910-a89a-8a0359997db3-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d9126046-fdc5-4322-8141-73e02a9b1dda tempest-VolumesExtendTest-1542751612 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.ff30571f-556b-416b-813f-de61fee021a0 2G" returned: 0 in 0.135s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d9126046-fdc5-4322-8141-73e02a9b1dda tempest-VolumesExtendTest-1542751612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.751s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:01 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-d9126046-fdc5-4322-8141-73e02a9b1dda tempest-VolumesExtendTest-1542751612 None] Extend volume completed successfully. Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-510d2e56-4776-4234-8d76-4142aabebadf tempest-VolumesGetTest-756263227 None] Acquiring lock "cinder-63911a0e-cee7-4adf-b05a-23af5cc50cc2-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-510d2e56-4776-4234-8d76-4142aabebadf tempest-VolumesGetTest-756263227 None] Lock "cinder-63911a0e-cee7-4adf-b05a-23af5cc50cc2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5a2b8601-7b4e-4f7d-b77a-bf53c846bee9 tempest-VolumesExtendTest-1542751612 None] Acquiring lock "cinder-ff30571f-556b-416b-813f-de61fee021a0-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5a2b8601-7b4e-4f7d-b77a-bf53c846bee9 tempest-VolumesExtendTest-1542751612 None] Lock "cinder-ff30571f-556b-416b-813f-de61fee021a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5a2b8601-7b4e-4f7d-b77a-bf53c846bee9 tempest-VolumesExtendTest-1542751612 None] Acquiring lock "cinder-quobyte-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-510d2e56-4776-4234-8d76-4142aabebadf tempest-VolumesGetTest-756263227 None] Acquiring lock "cinder-quobyte-63911a0e-cee7-4adf-b05a-23af5cc50cc2" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5a2b8601-7b4e-4f7d-b77a-bf53c846bee9 tempest-VolumesExtendTest-1542751612 None] Lock "cinder-quobyte-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5a2b8601-7b4e-4f7d-b77a-bf53c846bee9 tempest-VolumesExtendTest-1542751612 None] Acquiring lock "cinder-quobyte-ff30571f-556b-416b-813f-de61fee021a0" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5a2b8601-7b4e-4f7d-b77a-bf53c846bee9 tempest-VolumesExtendTest-1542751612 None] Lock "cinder-quobyte-ff30571f-556b-416b-813f-de61fee021a0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-5a2b8601-7b4e-4f7d-b77a-bf53c846bee9 tempest-VolumesExtendTest-1542751612 None] Deleting offline snapshot ff30571f-556b-416b-813f-de61fee021a0 of volume e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-5a2b8601-7b4e-4f7d-b77a-bf53c846bee9 tempest-VolumesExtendTest-1542751612 None] snapshot_file for this snap is: volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.ff30571f-556b-416b-813f-de61fee021a0 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-510d2e56-4776-4234-8d76-4142aabebadf tempest-VolumesGetTest-756263227 None] Lock "cinder-quobyte-63911a0e-cee7-4adf-b05a-23af5cc50cc2" acquired by "delete_volume" :: waited 0.048s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b984b2-78fd-4a05-a0a5-2ceba32b5c93]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5a2b8601-7b4e-4f7d-b77a-bf53c846bee9 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.ff30571f-556b-416b-813f-de61fee021a0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a8f905-378c-431e-bb7d-10076a9a3ad4]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-510d2e56-4776-4234-8d76-4142aabebadf tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:01 devstack sudo[89644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.ff30571f-556b-416b-813f-de61fee021a0 Apr 28 05:57:01 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:01 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 Apr 28 05:57:01 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:02 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5a2b8601-7b4e-4f7d-b77a-bf53c846bee9 tempest-VolumesExtendTest-1542751612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.ff30571f-556b-416b-813f-de61fee021a0" returned: 0 in 0.529s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:02 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-5a2b8601-7b4e-4f7d-b77a-bf53c846bee9 tempest-VolumesExtendTest-1542751612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:57:02 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[50079242-a4e9-4122-8c46-c519743cda5e]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5a2b8601-7b4e-4f7d-b77a-bf53c846bee9 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:02 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-510d2e56-4776-4234-8d76-4142aabebadf tempest-VolumesGetTest-756263227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2" returned: 0 in 0.551s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-510d2e56-4776-4234-8d76-4142aabebadf tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:02 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2 Apr 28 05:57:02 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:02 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c Apr 28 05:57:02 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:02 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-510d2e56-4776-4234-8d76-4142aabebadf tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-63911a0e-cee7-4adf-b05a-23af5cc50cc2" returned: 0 in 0.453s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:02 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-510d2e56-4776-4234-8d76-4142aabebadf tempest-VolumesGetTest-756263227 None] Lock "cinder-quobyte-63911a0e-cee7-4adf-b05a-23af5cc50cc2" released by "delete_volume" :: held 1.065s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:02 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-510d2e56-4776-4234-8d76-4142aabebadf tempest-VolumesGetTest-756263227 None] Created reservations ['dc9eb593-d5d6-4a6a-adf5-efe0ad9635a9', '13fa05bd-dc66-42de-a322-bb5976b095ad', '76e48439-9c74-48c6-a83b-96e27b794875', 'cf712a9f-7ce2-4fb5-b503-e6cb34d80201'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:57:02 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5a2b8601-7b4e-4f7d-b77a-bf53c846bee9 tempest-VolumesExtendTest-1542751612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c" returned: 0 in 0.575s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5a2b8601-7b4e-4f7d-b77a-bf53c846bee9 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.ff30571f-556b-416b-813f-de61fee021a0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-510d2e56-4776-4234-8d76-4142aabebadf tempest-VolumesGetTest-756263227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-510d2e56-4776-4234-8d76-4142aabebadf tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:02 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-510d2e56-4776-4234-8d76-4142aabebadf tempest-VolumesGetTest-756263227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:02 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.ff30571f-556b-416b-813f-de61fee021a0 Apr 28 05:57:02 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:02 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-510d2e56-4776-4234-8d76-4142aabebadf tempest-VolumesGetTest-756263227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-510d2e56-4776-4234-8d76-4142aabebadf tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-510d2e56-4776-4234-8d76-4142aabebadf tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:03 devstack sudo[89664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:57:03 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:03 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-510d2e56-4776-4234-8d76-4142aabebadf tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.494s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:03 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-510d2e56-4776-4234-8d76-4142aabebadf tempest-VolumesGetTest-756263227 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:57:03 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-510d2e56-4776-4234-8d76-4142aabebadf tempest-VolumesGetTest-756263227 None] Deleted volume successfully. Apr 28 05:57:03 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-510d2e56-4776-4234-8d76-4142aabebadf tempest-VolumesGetTest-756263227 None] Lock "cinder-63911a0e-cee7-4adf-b05a-23af5cc50cc2-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:03 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5a2b8601-7b4e-4f7d-b77a-bf53c846bee9 tempest-VolumesExtendTest-1542751612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.ff30571f-556b-416b-813f-de61fee021a0" returned: 0 in 0.584s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5a2b8601-7b4e-4f7d-b77a-bf53c846bee9 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.ff30571f-556b-416b-813f-de61fee021a0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:03 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.ff30571f-556b-416b-813f-de61fee021a0 Apr 28 05:57:03 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:04 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5a2b8601-7b4e-4f7d-b77a-bf53c846bee9 tempest-VolumesExtendTest-1542751612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c.ff30571f-556b-416b-813f-de61fee021a0" returned: 0 in 0.493s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5a2b8601-7b4e-4f7d-b77a-bf53c846bee9 tempest-VolumesExtendTest-1542751612 None] Lock "cinder-quobyte-ff30571f-556b-416b-813f-de61fee021a0" released by "_delete_snapshot" :: held 2.304s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5a2b8601-7b4e-4f7d-b77a-bf53c846bee9 tempest-VolumesExtendTest-1542751612 None] Lock "cinder-quobyte-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c" released by "delete_snapshot" :: held 2.330s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:04 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-5a2b8601-7b4e-4f7d-b77a-bf53c846bee9 tempest-VolumesExtendTest-1542751612 None] Created reservations ['70ddb75a-05af-4d5e-b5bb-bdbdc1f490fe', 'f62e403b-22b3-4273-987b-8cfd9393afc4', '78f2f2bf-b03c-4ffb-81a2-d9d15b1c637a', '405cbc1e-5885-40b2-af6b-0938ebb87b35'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:57:04 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-5a2b8601-7b4e-4f7d-b77a-bf53c846bee9 tempest-VolumesExtendTest-1542751612 None] Delete snapshot completed successfully. Apr 28 05:57:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5a2b8601-7b4e-4f7d-b77a-bf53c846bee9 tempest-VolumesExtendTest-1542751612 None] Lock "cinder-ff30571f-556b-416b-813f-de61fee021a0-delete_snapshot" released by "delete_snapshot" :: held 2.520s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:04 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:57:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Flow 'volume_create_manager' (fb00f318-b6eb-459a-bbb6-8b6702f0c6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed027c1-ca6d-4cca-9bc0-36b4cb67291e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed027c1-ca6d-4cca-9bc0-36b4cb67291e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-996046690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='15598e5c9f2249a38be905d2fede6eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:04Z,use_quota=True,user_id='47f36862f6cc4b2f8eb125fb5a62c15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47858434-600b-45b6-b1eb-1c87e8e05ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47858434-600b-45b6-b1eb-1c87e8e05ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e19950-de35-4c05-b09c-2d20db770f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:04 devstack cinder-volume[81829]: DEBUG cinder.image.glance [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Creating Keystone auth plugin from conf {{(pid=81829) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 28 05:57:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e19950-de35-4c05-b09c-2d20db770f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52', 'volume_name': 'volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52', 'volume_size': 1, 'image_id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe365410c9347328bf4beafdac90830', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'created_at': datetime.datetime(2026, 4, 28, 3, 43, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 3, 43, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25b85b0b-bf76-421a-869b-c686c236a28b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85db78b7-8471-40c4-bef1-fe2e885c8cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85db78b7-8471-40c4-bef1-fe2e885c8cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:04 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a37dc822-7ef3-42be-811e-92a5986eafa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:04 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Volume f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52', 'volume_size': 1, 'image_id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe365410c9347328bf4beafdac90830', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'created_at': datetime.datetime(2026, 4, 28, 3, 43, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 3, 43, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25b85b0b-bf76-421a-869b-c686c236a28b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 28 05:57:04 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Trying to clone f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 from image 25b85b0b-bf76-421a-869b-c686c236a28b at location (None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}]). {{(pid=81829) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 28 05:57:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d9069e74-3eaf-48eb-a5da-f4a88d3d3d93 tempest-VolumesExtendTest-1542751612 None] Acquiring lock "cinder-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d9069e74-3eaf-48eb-a5da-f4a88d3d3d93 tempest-VolumesExtendTest-1542751612 None] Lock "cinder-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d9069e74-3eaf-48eb-a5da-f4a88d3d3d93 tempest-VolumesExtendTest-1542751612 None] Acquiring lock "cinder-quobyte-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d9069e74-3eaf-48eb-a5da-f4a88d3d3d93 tempest-VolumesExtendTest-1542751612 None] Lock "cinder-quobyte-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c" acquired by "delete_volume" :: waited 0.033s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:05 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94cc27c-f720-4e8d-ba36-69aa53782f88]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d9069e74-3eaf-48eb-a5da-f4a88d3d3d93 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:05 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7r1utzj0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81829) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 28 05:57:05 devstack cinder-volume[81829]: INFO cinder.image.image_utils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Image download 20.69 MB at 20.69 MB/s Apr 28 05:57:05 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cef6036-a4d0-4c74-9d69-96662ce677f6]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7r1utzj0devstack@QuobyteHD {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:05 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c Apr 28 05:57:05 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:05 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7r1utzj0devstack@QuobyteHD Apr 28 05:57:05 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:05 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d9069e74-3eaf-48eb-a5da-f4a88d3d3d93 tempest-VolumesExtendTest-1542751612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c" returned: 0 in 0.554s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d9069e74-3eaf-48eb-a5da-f4a88d3d3d93 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:05 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c Apr 28 05:57:05 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:05 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7r1utzj0devstack@QuobyteHD" returned: 0 in 0.512s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:05 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Temporary image 25b85b0b-bf76-421a-869b-c686c236a28b is fetched for user 47f36862f6cc4b2f8eb125fb5a62c15b. {{(pid=81829) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 28 05:57:05 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cc349a-b4fd-4ec2-8a51-ca16482e4e71]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7r1utzj0devstack@QuobyteHD {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:05 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7r1utzj0devstack@QuobyteHD Apr 28 05:57:05 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:06 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d9069e74-3eaf-48eb-a5da-f4a88d3d3d93 tempest-VolumesExtendTest-1542751612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c" returned: 0 in 0.462s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d9069e74-3eaf-48eb-a5da-f4a88d3d3d93 tempest-VolumesExtendTest-1542751612 None] Lock "cinder-quobyte-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c" released by "delete_volume" :: held 1.081s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-d9069e74-3eaf-48eb-a5da-f4a88d3d3d93 tempest-VolumesExtendTest-1542751612 None] Created reservations ['c1d16349-55d8-449a-9c5a-e5f522dd88cc', '9e3240dc-e505-4784-bdbb-2e203fbdabe0', '98ad0e1f-098a-4b4c-9700-4a1cefbea687', '5fa3ff05-c802-417a-9c61-379b657bc85e'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d9069e74-3eaf-48eb-a5da-f4a88d3d3d93 tempest-VolumesExtendTest-1542751612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d9069e74-3eaf-48eb-a5da-f4a88d3d3d93 tempest-VolumesExtendTest-1542751612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d9069e74-3eaf-48eb-a5da-f4a88d3d3d93 tempest-VolumesExtendTest-1542751612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d9069e74-3eaf-48eb-a5da-f4a88d3d3d93 tempest-VolumesExtendTest-1542751612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d9069e74-3eaf-48eb-a5da-f4a88d3d3d93 tempest-VolumesExtendTest-1542751612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d9069e74-3eaf-48eb-a5da-f4a88d3d3d93 tempest-VolumesExtendTest-1542751612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:06 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:57:06 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:06 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7r1utzj0devstack@QuobyteHD" returned: 0 in 0.521s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-996046690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='15598e5c9f2249a38be905d2fede6eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:04Z,use_quota=True,user_id='47f36862f6cc4b2f8eb125fb5a62c15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Creating volume f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:57:06 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:06 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 1073741824 Apr 28 05:57:06 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:06 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d9069e74-3eaf-48eb-a5da-f4a88d3d3d93 tempest-VolumesExtendTest-1542751612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.489s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-d9069e74-3eaf-48eb-a5da-f4a88d3d3d93 tempest-VolumesExtendTest-1542751612 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:57:06 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-d9069e74-3eaf-48eb-a5da-f4a88d3d3d93 tempest-VolumesExtendTest-1542751612 None] Deleted volume successfully. Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d9069e74-3eaf-48eb-a5da-f4a88d3d3d93 tempest-VolumesExtendTest-1542751612 None] Lock "cinder-e5fcc1ca-c63f-4c6e-8db7-8fd4a968011c-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:06 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 1073741824" returned: 0 in 0.604s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:06 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 Apr 28 05:57:06 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG oslo_service.periodic_task [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81829) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:06 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:57:06 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:07 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52" returned: 0 in 0.501s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:07 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:57:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:07 devstack cinder-volume[81829]: DEBUG cinder.volume.volume_utils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Attempting download of 25b85b0b-bf76-421a-869b-c686c236a28b ((None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}])) to volume f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52. {{(pid=81829) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 28 05:57:07 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.529s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:07 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:57:07 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[8add888b-fabe-474f-b7af-89ab94fb4d92]: (4, 'raw') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_ivjnndow {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:07 devstack sudo[89706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_ivjnndow Apr 28 05:57:07 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:08 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_ivjnndow" returned: 0 in 0.531s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_ivjnndow {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:08 devstack sudo[89711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_ivjnndow Apr 28 05:57:08 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:08 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_ivjnndow" returned: 1 in 0.551s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_25b85b0b-bf76-421a-869b-c686c236a28b_ivjnndow' failed. Not Retrying. {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 05:57:08 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[a608345b-b0a7-4878-a998-b37d88591c2e]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7r1utzj0devstack@QuobyteHD {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:08 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7r1utzj0devstack@QuobyteHD Apr 28 05:57:08 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:09 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7r1utzj0devstack@QuobyteHD" returned: 0 in 0.546s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] 25b85b0b-bf76-421a-869b-c686c236a28b was qcow2, converting to raw {{(pid=81829) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7r1utzj0devstack@QuobyteHD /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:09 devstack sudo[89722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7r1utzj0devstack@QuobyteHD /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 Apr 28 05:57:09 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Flow 'volume_create_manager' (b5de1085-75b2-4f03-b6e8-61fffbb0c1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5fa3a17-c380-4583-a7dc-2130e625b145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5fa3a17-c380-4583-a7dc-2130e625b145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-202316883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963db76b1e8242ffa2b3cebdab39bd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:10Z,use_quota=True,user_id='e8c4a811f02b4b05af355499ab987892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569e022b-d4bc-43cc-ae9e-45987c45191f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569e022b-d4bc-43cc-ae9e-45987c45191f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96d606a-08ea-4f54-996d-131ad0cd4114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96d606a-08ea-4f54-996d-131ad0cd4114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31', 'volume_name': 'volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb44f0bd-1df2-4838-b443-3b88a03ee3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb44f0bd-1df2-4838-b443-3b88a03ee3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d067093-1faf-426c-a9a4-4d622df05ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:09 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Volume 183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31', 'volume_size': 1} Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-202316883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963db76b1e8242ffa2b3cebdab39bd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:10Z,use_quota=True,user_id='e8c4a811f02b4b05af355499ab987892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Creating volume 183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:57:09 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:57:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:09 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31 1073741824 Apr 28 05:57:09 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:10 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:10 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7r1utzj0devstack@QuobyteHD /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52" returned: 0 in 1.454s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:10 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_25b85b0b-bf76-421a-869b-c686c236a28b_7r1utzj0devstack@QuobyteHD, size 112.00 MB, duration 1.46 sec, destination /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 {{(pid=81829) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:57:10 devstack cinder-volume[81829]: INFO cinder.image.image_utils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Converted 112.00 MB image at 76.94 MB/s Apr 28 05:57:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31 1073741824" returned: 0 in 0.740s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:10 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 1G Apr 28 05:57:10 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:10 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31 Apr 28 05:57:10 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:11 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 1G" returned: 0 in 0.505s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:11 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31" returned: 0 in 0.465s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:11 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:57:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d067093-1faf-426c-a9a4-4d622df05ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a051d41f-ec26-4d90-8307-52045e49de7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:11 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8793e1-e143-4aac-acff-83b1eb296559]: (4, 'raw') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:11 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Volume volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31 (183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31): created successfully Apr 28 05:57:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a051d41f-ec26-4d90-8307-52045e49de7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Flow 'volume_create_manager' (b5de1085-75b2-4f03-b6e8-61fffbb0c1d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:11 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-25918566-6f3c-49f3-b835-ae6fd510abf4 tempest-CreateVolumesFromSnapshotTest-658872456 None] Created volume successfully. Apr 28 05:57:11 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 Apr 28 05:57:11 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:11 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52" returned: 0 in 0.519s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:11 devstack sudo[89754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 Apr 28 05:57:11 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-68804f2f-6d7b-474d-bbfd-08bbb0f4624b tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-68804f2f-6d7b-474d-bbfd-08bbb0f4624b tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:12 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-68804f2f-6d7b-474d-bbfd-08bbb0f4624b tempest-CreateVolumesFromSnapshotTest-658872456 None] Creating offline snapshot 8c3c08f3-dc88-422b-9042-34044d735406 of volume 183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:57:12 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f492c9-5199-4774-82b5-20bb91d6c050]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-68804f2f-6d7b-474d-bbfd-08bbb0f4624b tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:12 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31 Apr 28 05:57:12 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:12 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52" returned: 1 in 0.522s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52' failed. Not Retrying. {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 05:57:12 devstack cinder-volume[81829]: DEBUG cinder.volume.volume_utils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Downloaded image 25b85b0b-bf76-421a-869b-c686c236a28b ((None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}])) to volume f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 successfully. {{(pid=81829) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 28 05:57:12 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Temporary image 25b85b0b-bf76-421a-869b-c686c236a28b for user 47f36862f6cc4b2f8eb125fb5a62c15b is deleted. {{(pid=81829) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 28 05:57:12 devstack cinder-volume[81829]: DEBUG cinder.volume.volume_utils [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Marking volume f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 as bootable. {{(pid=81829) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 28 05:57:12 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Copying metadata from image 25b85b0b-bf76-421a-869b-c686c236a28b to f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52. {{(pid=81829) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 28 05:57:12 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Creating volume glance metadata for volume f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 backed by image 25b85b0b-bf76-421a-869b-c686c236a28b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81829) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 28 05:57:12 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a37dc822-7ef3-42be-811e-92a5986eafa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52', 'volume_size': 1, 'image_id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/25b85b0b-bf76-421a-869b-c686c236a28b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0fe365410c9347328bf4beafdac90830', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '25b85b0b-bf76-421a-869b-c686c236a28b', 'created_at': datetime.datetime(2026, 4, 28, 3, 43, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 3, 43, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/25b85b0b-bf76-421a-869b-c686c236a28b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:12 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3a0c52-9e33-4bcc-abc2-1a53a98bc89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:12 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Volume volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 (f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52): created successfully Apr 28 05:57:12 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3a0c52-9e33-4bcc-abc2-1a53a98bc89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:12 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Flow 'volume_create_manager' (fb00f318-b6eb-459a-bbb6-8b6702f0c6f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:12 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-dcfa49c0-9f11-436f-aa90-c7a6b12be693 tempest-VolumesGetTest-756263227 None] Created volume successfully. Apr 28 05:57:12 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-68804f2f-6d7b-474d-bbfd-08bbb0f4624b tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31" returned: 0 in 0.568s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-68804f2f-6d7b-474d-bbfd-08bbb0f4624b tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.8c3c08f3-dc88-422b-9042-34044d735406 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:12 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.8c3c08f3-dc88-422b-9042-34044d735406 1G Apr 28 05:57:12 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:13 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-68804f2f-6d7b-474d-bbfd-08bbb0f4624b tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.8c3c08f3-dc88-422b-9042-34044d735406 1G" returned: 0 in 0.629s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-68804f2f-6d7b-474d-bbfd-08bbb0f4624b tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.8c3c08f3-dc88-422b-9042-34044d735406 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:13 devstack sudo[89769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.8c3c08f3-dc88-422b-9042-34044d735406 Apr 28 05:57:13 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:13 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:57:13 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Flow 'volume_create_manager' (0084304a-77da-4820-9994-fd51c9488f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:13 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a5f0ff-730a-4a9f-be5e-12ddbf82ffea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:13 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a5f0ff-730a-4a9f-be5e-12ddbf82ffea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1390455469',display_name='tempest-VolumesGetTest-Volume-2036510771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b59fc36-82ff-4dde-9c1a-73d594695d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15598e5c9f2249a38be905d2fede6eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:14Z,use_quota=True,user_id='47f36862f6cc4b2f8eb125fb5a62c15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:13 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0effa57-b8ae-4051-a7c9-5e3de852c9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:13 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0effa57-b8ae-4051-a7c9-5e3de852c9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:13 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d176ce-290f-48ef-9474-a3e90ad32eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:13 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d176ce-290f-48ef-9474-a3e90ad32eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b59fc36-82ff-4dde-9c1a-73d594695d56', 'volume_name': 'volume-6b59fc36-82ff-4dde-9c1a-73d594695d56', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:13 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aa52a66-a9ff-4395-9ee8-0fc4452390f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:13 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aa52a66-a9ff-4395-9ee8-0fc4452390f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:13 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0b50fb-3eb9-48eb-ad1d-8c87c61fd9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:13 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Volume 6b59fc36-82ff-4dde-9c1a-73d594695d56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b59fc36-82ff-4dde-9c1a-73d594695d56', 'volume_size': 1} Apr 28 05:57:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:13 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-68804f2f-6d7b-474d-bbfd-08bbb0f4624b tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.8c3c08f3-dc88-422b-9042-34044d735406" returned: 0 in 0.512s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:13 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-68804f2f-6d7b-474d-bbfd-08bbb0f4624b tempest-CreateVolumesFromSnapshotTest-658872456 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.8c3c08f3-dc88-422b-9042-34044d735406 is being set with open permissions: ugo+rw Apr 28 05:57:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-68804f2f-6d7b-474d-bbfd-08bbb0f4624b tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.8c3c08f3-dc88-422b-9042-34044d735406 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:13 devstack sudo[89774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.8c3c08f3-dc88-422b-9042-34044d735406 Apr 28 05:57:13 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:14 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-68804f2f-6d7b-474d-bbfd-08bbb0f4624b tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.8c3c08f3-dc88-422b-9042-34044d735406" returned: 0 in 0.429s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-68804f2f-6d7b-474d-bbfd-08bbb0f4624b tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:14 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.info Apr 28 05:57:14 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:14 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-68804f2f-6d7b-474d-bbfd-08bbb0f4624b tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.info" returned: 0 in 0.453s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:14 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-68804f2f-6d7b-474d-bbfd-08bbb0f4624b tempest-CreateVolumesFromSnapshotTest-658872456 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.info is being set with open permissions: ugo+rw Apr 28 05:57:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-68804f2f-6d7b-474d-bbfd-08bbb0f4624b tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:14 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.info Apr 28 05:57:14 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:15 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-68804f2f-6d7b-474d-bbfd-08bbb0f4624b tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.info" returned: 0 in 0.423s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-68804f2f-6d7b-474d-bbfd-08bbb0f4624b tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.098s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.501s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1390455469',display_name='tempest-VolumesGetTest-Volume-2036510771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b59fc36-82ff-4dde-9c1a-73d594695d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15598e5c9f2249a38be905d2fede6eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:14Z,use_quota=True,user_id='47f36862f6cc4b2f8eb125fb5a62c15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:57:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Creating volume 6b59fc36-82ff-4dde-9c1a-73d594695d56 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:57:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:57:15 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:57:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6b59fc36-82ff-4dde-9c1a-73d594695d56 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:15 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6b59fc36-82ff-4dde-9c1a-73d594695d56 1073741824 Apr 28 05:57:15 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:15 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-68804f2f-6d7b-474d-bbfd-08bbb0f4624b tempest-CreateVolumesFromSnapshotTest-658872456 None] Create snapshot completed successfully Apr 28 05:57:15 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6b59fc36-82ff-4dde-9c1a-73d594695d56 1073741824" returned: 0 in 0.613s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6b59fc36-82ff-4dde-9c1a-73d594695d56 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:15 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6b59fc36-82ff-4dde-9c1a-73d594695d56 Apr 28 05:57:15 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:16 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6b59fc36-82ff-4dde-9c1a-73d594695d56" returned: 0 in 0.459s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0b50fb-3eb9-48eb-ad1d-8c87c61fd9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b59fc36-82ff-4dde-9c1a-73d594695d56', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cfa9503-a660-4f4f-8bb3-dd50af9b1317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:16 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Volume volume-6b59fc36-82ff-4dde-9c1a-73d594695d56 (6b59fc36-82ff-4dde-9c1a-73d594695d56): created successfully Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cfa9503-a660-4f4f-8bb3-dd50af9b1317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Flow 'volume_create_manager' (0084304a-77da-4820-9994-fd51c9488f7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:16 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-12f7dedd-9fe4-4941-8a43-da0e552954b5 tempest-VolumesGetTest-756263227 None] Created volume successfully. Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Flow 'volume_create_manager' (00fd9f99-5226-4877-bfb6-18f306ed61a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c239a4c-f6e1-4784-bda3-7a5578d2ddc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c239a4c-f6e1-4784-bda3-7a5578d2ddc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1059449547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e508c66-6330-49f7-89cc-3092b5658620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963db76b1e8242ffa2b3cebdab39bd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:16Z,use_quota=True,user_id='e8c4a811f02b4b05af355499ab987892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2333aa4a-f222-41ce-8cf6-4b3667d63703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2333aa4a-f222-41ce-8cf6-4b3667d63703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d8280b-3adb-4365-8a18-8c7cffc299ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d8280b-3adb-4365-8a18-8c7cffc299ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e508c66-6330-49f7-89cc-3092b5658620', 'volume_name': 'volume-0e508c66-6330-49f7-89cc-3092b5658620', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baa17114-fb98-48bf-a77d-f52cbc2aa35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baa17114-fb98-48bf-a77d-f52cbc2aa35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2614fd7e-84fb-4970-a4ae-ecf8c0fac094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:16 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Volume 0e508c66-6330-49f7-89cc-3092b5658620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e508c66-6330-49f7-89cc-3092b5658620', 'volume_size': 1} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1059449547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e508c66-6330-49f7-89cc-3092b5658620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963db76b1e8242ffa2b3cebdab39bd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:16Z,use_quota=True,user_id='e8c4a811f02b4b05af355499ab987892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Creating volume 0e508c66-6330-49f7-89cc-3092b5658620 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:57:16 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e508c66-6330-49f7-89cc-3092b5658620 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:16 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e508c66-6330-49f7-89cc-3092b5658620 1073741824 Apr 28 05:57:16 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Flow 'volume_create_manager' (8dabaef3-2000-4b85-b8a6-685d468e8226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a6557a6-5089-4924-b5d0-4973dec4aa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a6557a6-5089-4924-b5d0-4973dec4aa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-341093589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fde0e029-d541-44e6-8208-75a73cda1074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963db76b1e8242ffa2b3cebdab39bd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:17Z,use_quota=True,user_id='e8c4a811f02b4b05af355499ab987892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf53905-6b94-4b0f-94b5-55a5aaa5fc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf53905-6b94-4b0f-94b5-55a5aaa5fc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec6955c-0044-43b9-9cb6-b92ed92b7f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec6955c-0044-43b9-9cb6-b92ed92b7f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fde0e029-d541-44e6-8208-75a73cda1074', 'volume_name': 'volume-fde0e029-d541-44e6-8208-75a73cda1074', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64cfe161-7500-42f5-8855-57e2df03f715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64cfe161-7500-42f5-8855-57e2df03f715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50dc0d4-55b4-44a1-8f7f-5001fb07c79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:16 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Volume fde0e029-d541-44e6-8208-75a73cda1074: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fde0e029-d541-44e6-8208-75a73cda1074', 'volume_size': 1} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b14e1a7d-85b5-44ef-90e8-5d04bd8e0122 tempest-VolumesGetTest-756263227 None] Acquiring lock "cinder-6b59fc36-82ff-4dde-9c1a-73d594695d56-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:16 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b14e1a7d-85b5-44ef-90e8-5d04bd8e0122 tempest-VolumesGetTest-756263227 None] Lock "cinder-6b59fc36-82ff-4dde-9c1a-73d594695d56-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b14e1a7d-85b5-44ef-90e8-5d04bd8e0122 tempest-VolumesGetTest-756263227 None] Acquiring lock "cinder-quobyte-6b59fc36-82ff-4dde-9c1a-73d594695d56" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b14e1a7d-85b5-44ef-90e8-5d04bd8e0122 tempest-VolumesGetTest-756263227 None] Lock "cinder-quobyte-6b59fc36-82ff-4dde-9c1a-73d594695d56" acquired by "delete_volume" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[574811fb-7646-468f-bac0-d00884bf55ac]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b14e1a7d-85b5-44ef-90e8-5d04bd8e0122 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6b59fc36-82ff-4dde-9c1a-73d594695d56 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Flow 'volume_create_manager' (9c58f78e-fc6c-4a28-b676-3ec08ae25d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c356e335-cd0b-4cd9-91da-c6f9783891da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c356e335-cd0b-4cd9-91da-c6f9783891da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-889073127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fbcd6be-2556-4932-bc59-b959f3190570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963db76b1e8242ffa2b3cebdab39bd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:17Z,use_quota=True,user_id='e8c4a811f02b4b05af355499ab987892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88354ead-139a-4cad-be70-2e782c2d9bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88354ead-139a-4cad-be70-2e782c2d9bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1be6d2-09e3-410a-b5b7-25c6aec45459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1be6d2-09e3-410a-b5b7-25c6aec45459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fbcd6be-2556-4932-bc59-b959f3190570', 'volume_name': 'volume-5fbcd6be-2556-4932-bc59-b959f3190570', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:17 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6b59fc36-82ff-4dde-9c1a-73d594695d56 Apr 28 05:57:17 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6049b4ac-f4b8-45bc-a92d-07b4b79c65ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6049b4ac-f4b8-45bc-a92d-07b4b79c65ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47cc0215-b5f3-47e5-85f3-da60e5751f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:17 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Volume 5fbcd6be-2556-4932-bc59-b959f3190570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fbcd6be-2556-4932-bc59-b959f3190570', 'volume_size': 1} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:17 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e508c66-6330-49f7-89cc-3092b5658620 1073741824" returned: 0 in 0.850s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Flow 'volume_create_manager' (64040025-ce26-4087-b4ae-ccec66932be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c676e415-073f-4406-b815-bd7c38bf52db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c676e415-073f-4406-b815-bd7c38bf52db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1513149335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d976df67-9046-4018-aea1-4b7b2054699c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963db76b1e8242ffa2b3cebdab39bd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:17Z,use_quota=True,user_id='e8c4a811f02b4b05af355499ab987892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7fae33-c68b-44aa-96a1-7f578eaa5f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7fae33-c68b-44aa-96a1-7f578eaa5f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc7eaad-2bcf-4e8c-b288-25ade2286f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc7eaad-2bcf-4e8c-b288-25ade2286f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd976df67-9046-4018-aea1-4b7b2054699c', 'volume_name': 'volume-d976df67-9046-4018-aea1-4b7b2054699c', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3fccce4-c249-4d96-b8e2-959a428b1199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3fccce4-c249-4d96-b8e2-959a428b1199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb07ede-4946-476c-a06e-4344a61f48e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:17 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Volume d976df67-9046-4018-aea1-4b7b2054699c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d976df67-9046-4018-aea1-4b7b2054699c', 'volume_size': 1} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e508c66-6330-49f7-89cc-3092b5658620 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:17 devstack sudo[89798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e508c66-6330-49f7-89cc-3092b5658620 Apr 28 05:57:17 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:17 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b14e1a7d-85b5-44ef-90e8-5d04bd8e0122 tempest-VolumesGetTest-756263227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6b59fc36-82ff-4dde-9c1a-73d594695d56" returned: 0 in 0.638s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b14e1a7d-85b5-44ef-90e8-5d04bd8e0122 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6b59fc36-82ff-4dde-9c1a-73d594695d56 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:17 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6b59fc36-82ff-4dde-9c1a-73d594695d56 Apr 28 05:57:17 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Flow 'volume_create_manager' (028a4b9f-a104-4742-a93a-e98d118d0fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f56722c7-ada2-4687-ab1f-4a329c424638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f56722c7-ada2-4687-ab1f-4a329c424638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1362260881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=618e8069-5f19-4f31-bec2-3713eb898041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963db76b1e8242ffa2b3cebdab39bd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:18Z,use_quota=True,user_id='e8c4a811f02b4b05af355499ab987892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9200cc5b-9b64-4777-b767-d175df060a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9200cc5b-9b64-4777-b767-d175df060a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1507a7-e1be-49eb-ac9a-583063c7c09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1507a7-e1be-49eb-ac9a-583063c7c09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '618e8069-5f19-4f31-bec2-3713eb898041', 'volume_name': 'volume-618e8069-5f19-4f31-bec2-3713eb898041', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e399d0-db0d-45d1-bf06-5d1192f96930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e399d0-db0d-45d1-bf06-5d1192f96930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd55695-7ee8-4d55-8983-6974b4cf9c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:17 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Volume 618e8069-5f19-4f31-bec2-3713eb898041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-618e8069-5f19-4f31-bec2-3713eb898041', 'volume_size': 1} Apr 28 05:57:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:18 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e508c66-6330-49f7-89cc-3092b5658620" returned: 0 in 0.491s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.103s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-341093589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fde0e029-d541-44e6-8208-75a73cda1074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963db76b1e8242ffa2b3cebdab39bd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:17Z,use_quota=True,user_id='e8c4a811f02b4b05af355499ab987892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Creating volume fde0e029-d541-44e6-8208-75a73cda1074 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:57:18 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fde0e029-d541-44e6-8208-75a73cda1074 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2614fd7e-84fb-4970-a4ae-ecf8c0fac094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e508c66-6330-49f7-89cc-3092b5658620', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:18 devstack sudo[89806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fde0e029-d541-44e6-8208-75a73cda1074 1073741824 Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7320b5ab-57e0-4d87-9689-2f0ac0b66c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:18 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:18 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Volume volume-0e508c66-6330-49f7-89cc-3092b5658620 (0e508c66-6330-49f7-89cc-3092b5658620): created successfully Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7320b5ab-57e0-4d87-9689-2f0ac0b66c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Flow 'volume_create_manager' (00fd9f99-5226-4877-bfb6-18f306ed61a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:18 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-e6610f71-7fcb-487d-be35-bf7eba7adfca tempest-CreateVolumesFromSnapshotTest-658872456 None] Created volume successfully. Apr 28 05:57:18 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b14e1a7d-85b5-44ef-90e8-5d04bd8e0122 tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6b59fc36-82ff-4dde-9c1a-73d594695d56" returned: 0 in 0.490s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b14e1a7d-85b5-44ef-90e8-5d04bd8e0122 tempest-VolumesGetTest-756263227 None] Lock "cinder-quobyte-6b59fc36-82ff-4dde-9c1a-73d594695d56" released by "delete_volume" :: held 1.176s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-b14e1a7d-85b5-44ef-90e8-5d04bd8e0122 tempest-VolumesGetTest-756263227 None] Created reservations ['4828b135-c692-4455-a106-a8f8b59881b3', 'e1207bc2-6876-4fe8-b431-646f2aab87fe', '142fd063-4cb2-46d5-b422-1a966d7ff560', '422fa2f2-de4c-48db-8818-1f4cbeb0386b'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b14e1a7d-85b5-44ef-90e8-5d04bd8e0122 tempest-VolumesGetTest-756263227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b14e1a7d-85b5-44ef-90e8-5d04bd8e0122 tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b14e1a7d-85b5-44ef-90e8-5d04bd8e0122 tempest-VolumesGetTest-756263227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b14e1a7d-85b5-44ef-90e8-5d04bd8e0122 tempest-VolumesGetTest-756263227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b14e1a7d-85b5-44ef-90e8-5d04bd8e0122 tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b14e1a7d-85b5-44ef-90e8-5d04bd8e0122 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:18 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:57:18 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:18 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fde0e029-d541-44e6-8208-75a73cda1074 1073741824" returned: 0 in 0.633s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fde0e029-d541-44e6-8208-75a73cda1074 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:18 devstack sudo[89815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fde0e029-d541-44e6-8208-75a73cda1074 Apr 28 05:57:18 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:18 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b14e1a7d-85b5-44ef-90e8-5d04bd8e0122 tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.456s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-b14e1a7d-85b5-44ef-90e8-5d04bd8e0122 tempest-VolumesGetTest-756263227 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:57:18 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-b14e1a7d-85b5-44ef-90e8-5d04bd8e0122 tempest-VolumesGetTest-756263227 None] Deleted volume successfully. Apr 28 05:57:18 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b14e1a7d-85b5-44ef-90e8-5d04bd8e0122 tempest-VolumesGetTest-756263227 None] Lock "cinder-6b59fc36-82ff-4dde-9c1a-73d594695d56-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] Acquiring lock "cinder-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] Lock "cinder-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:19 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fde0e029-d541-44e6-8208-75a73cda1074" returned: 0 in 0.475s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.028s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-889073127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fbcd6be-2556-4932-bc59-b959f3190570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963db76b1e8242ffa2b3cebdab39bd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:17Z,use_quota=True,user_id='e8c4a811f02b4b05af355499ab987892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Creating volume 5fbcd6be-2556-4932-bc59-b959f3190570 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:57:19 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5fbcd6be-2556-4932-bc59-b959f3190570 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50dc0d4-55b4-44a1-8f7f-5001fb07c79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fde0e029-d541-44e6-8208-75a73cda1074', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48433b9f-546e-498b-8dcc-5c7d3b5b7a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:19 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5fbcd6be-2556-4932-bc59-b959f3190570 1073741824 Apr 28 05:57:19 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] Acquiring lock "cinder-quobyte-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:19 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Volume volume-fde0e029-d541-44e6-8208-75a73cda1074 (fde0e029-d541-44e6-8208-75a73cda1074): created successfully Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48433b9f-546e-498b-8dcc-5c7d3b5b7a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Flow 'volume_create_manager' (8dabaef3-2000-4b85-b8a6-685d468e8226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:19 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-856fa144-47ac-46ce-8647-c6f98f8e846c tempest-CreateVolumesFromSnapshotTest-658872456 None] Created volume successfully. Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] Lock "cinder-quobyte-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52" acquired by "delete_volume" :: waited 0.039s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e9a363-6b3d-4c3b-9a8d-2b6c0664f1eb]: (4, 'raw') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:19 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 Apr 28 05:57:19 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:19 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5fbcd6be-2556-4932-bc59-b959f3190570 1073741824" returned: 0 in 0.620s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5fbcd6be-2556-4932-bc59-b959f3190570 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:19 devstack sudo[89827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5fbcd6be-2556-4932-bc59-b959f3190570 Apr 28 05:57:19 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:19 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52" returned: 0 in 0.571s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:20 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 Apr 28 05:57:20 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:20 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5fbcd6be-2556-4932-bc59-b959f3190570" returned: 0 in 0.453s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.824s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1513149335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d976df67-9046-4018-aea1-4b7b2054699c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963db76b1e8242ffa2b3cebdab39bd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:17Z,use_quota=True,user_id='e8c4a811f02b4b05af355499ab987892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Creating volume d976df67-9046-4018-aea1-4b7b2054699c {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:57:20 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d976df67-9046-4018-aea1-4b7b2054699c 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47cc0215-b5f3-47e5-85f3-da60e5751f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fbcd6be-2556-4932-bc59-b959f3190570', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26d71c8-e319-41fe-bc84-f78e7623f4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:20 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d976df67-9046-4018-aea1-4b7b2054699c 1073741824 Apr 28 05:57:20 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:20 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Volume volume-5fbcd6be-2556-4932-bc59-b959f3190570 (5fbcd6be-2556-4932-bc59-b959f3190570): created successfully Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26d71c8-e319-41fe-bc84-f78e7623f4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Flow 'volume_create_manager' (9c58f78e-fc6c-4a28-b676-3ec08ae25d02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:20 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-35092563-443f-42bf-bb68-e89f434b045d tempest-CreateVolumesFromSnapshotTest-658872456 None] Created volume successfully. Apr 28 05:57:20 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52" returned: 1 in 0.525s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52' failed. Not Retrying. {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:20 devstack sudo[89837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52 Apr 28 05:57:20 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:20 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52" returned: 0 in 0.465s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] Lock "cinder-quobyte-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52" released by "delete_volume" :: held 1.627s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] Created reservations ['75b5a8b7-6452-4852-9603-c77616d490e4', '0e7fefda-6018-441c-93b4-128dcd3d9257', '66a5c5ea-fad1-4e32-9379-85df97a84c57', '23b1fdd5-8600-499b-9d7c-de6f28329248'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:57:20 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d976df67-9046-4018-aea1-4b7b2054699c 1073741824" returned: 0 in 0.639s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d976df67-9046-4018-aea1-4b7b2054699c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:21 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d976df67-9046-4018-aea1-4b7b2054699c Apr 28 05:57:21 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:21 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:57:21 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:21 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d976df67-9046-4018-aea1-4b7b2054699c" returned: 0 in 0.445s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.677s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1362260881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=618e8069-5f19-4f31-bec2-3713eb898041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='963db76b1e8242ffa2b3cebdab39bd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:18Z,use_quota=True,user_id='e8c4a811f02b4b05af355499ab987892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Creating volume 618e8069-5f19-4f31-bec2-3713eb898041 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:57:21 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-618e8069-5f19-4f31-bec2-3713eb898041 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb07ede-4946-476c-a06e-4344a61f48e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d976df67-9046-4018-aea1-4b7b2054699c', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58319a1-ffa8-4056-80a2-28a22334ee86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:21 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Volume volume-d976df67-9046-4018-aea1-4b7b2054699c (d976df67-9046-4018-aea1-4b7b2054699c): created successfully Apr 28 05:57:21 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-618e8069-5f19-4f31-bec2-3713eb898041 1073741824 Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58319a1-ffa8-4056-80a2-28a22334ee86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:21 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Flow 'volume_create_manager' (64040025-ce26-4087-b4ae-ccec66932be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:21 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.469s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:57:21 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-59ba2794-b00f-4e28-b85a-1a2ab011297b tempest-CreateVolumesFromSnapshotTest-658872456 None] Created volume successfully. Apr 28 05:57:21 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] Deleted volume successfully. Apr 28 05:57:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7a1941cc-25cf-45aa-a99f-cff75e15e796 tempest-VolumesGetTest-756263227 None] Lock "cinder-f4dc6c1f-81ce-43ad-b5f5-01a4ccf44c52-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:22 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-618e8069-5f19-4f31-bec2-3713eb898041 1073741824" returned: 0 in 0.812s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-618e8069-5f19-4f31-bec2-3713eb898041 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:22 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-618e8069-5f19-4f31-bec2-3713eb898041 Apr 28 05:57:22 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:22 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-618e8069-5f19-4f31-bec2-3713eb898041" returned: 0 in 0.534s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:57:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd55695-7ee8-4d55-8983-6974b4cf9c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-618e8069-5f19-4f31-bec2-3713eb898041', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32097157-b7df-4d1f-bf69-3fec7d926e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:22 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Volume volume-618e8069-5f19-4f31-bec2-3713eb898041 (618e8069-5f19-4f31-bec2-3713eb898041): created successfully Apr 28 05:57:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32097157-b7df-4d1f-bf69-3fec7d926e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:22 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Flow 'volume_create_manager' (028a4b9f-a104-4742-a93a-e98d118d0fd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:22 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-06a825a6-07a8-4007-8560-aefb2580ca87 tempest-CreateVolumesFromSnapshotTest-658872456 None] Created volume successfully. Apr 28 05:57:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c72f8b58-e1bc-43a7-ac4e-50d5da4ab953 tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "cinder-618e8069-5f19-4f31-bec2-3713eb898041-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c72f8b58-e1bc-43a7-ac4e-50d5da4ab953 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-618e8069-5f19-4f31-bec2-3713eb898041-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c72f8b58-e1bc-43a7-ac4e-50d5da4ab953 tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "cinder-quobyte-618e8069-5f19-4f31-bec2-3713eb898041" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c72f8b58-e1bc-43a7-ac4e-50d5da4ab953 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-quobyte-618e8069-5f19-4f31-bec2-3713eb898041" acquired by "delete_volume" :: waited 0.020s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:23 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[92aa758f-5d7f-4be3-b0b4-64b113b1283a]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c72f8b58-e1bc-43a7-ac4e-50d5da4ab953 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-618e8069-5f19-4f31-bec2-3713eb898041 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:23 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-618e8069-5f19-4f31-bec2-3713eb898041 Apr 28 05:57:23 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:23 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c72f8b58-e1bc-43a7-ac4e-50d5da4ab953 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-618e8069-5f19-4f31-bec2-3713eb898041" returned: 0 in 0.542s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c72f8b58-e1bc-43a7-ac4e-50d5da4ab953 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-618e8069-5f19-4f31-bec2-3713eb898041 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:23 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-618e8069-5f19-4f31-bec2-3713eb898041 Apr 28 05:57:23 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:24 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c72f8b58-e1bc-43a7-ac4e-50d5da4ab953 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-618e8069-5f19-4f31-bec2-3713eb898041" returned: 0 in 0.489s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:24 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c72f8b58-e1bc-43a7-ac4e-50d5da4ab953 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-quobyte-618e8069-5f19-4f31-bec2-3713eb898041" released by "delete_volume" :: held 1.075s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:24 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-c72f8b58-e1bc-43a7-ac4e-50d5da4ab953 tempest-CreateVolumesFromSnapshotTest-658872456 None] Created reservations ['7ae08923-f9c3-4074-995b-fc97f4dbce5e', '53226e60-3cc6-4cb8-947c-cff64eaf5a3d', '6d374bb2-c5f9-4f89-8b19-3573ddbb25db', '126c1b49-2487-4e45-8a0a-8bfc47b8b5b1'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:57:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c72f8b58-e1bc-43a7-ac4e-50d5da4ab953 tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c72f8b58-e1bc-43a7-ac4e-50d5da4ab953 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:24 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c72f8b58-e1bc-43a7-ac4e-50d5da4ab953 tempest-CreateVolumesFromSnapshotTest-658872456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:24 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c72f8b58-e1bc-43a7-ac4e-50d5da4ab953 tempest-CreateVolumesFromSnapshotTest-658872456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c72f8b58-e1bc-43a7-ac4e-50d5da4ab953 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c72f8b58-e1bc-43a7-ac4e-50d5da4ab953 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:24 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:57:24 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:25 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c72f8b58-e1bc-43a7-ac4e-50d5da4ab953 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.495s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:25 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-c72f8b58-e1bc-43a7-ac4e-50d5da4ab953 tempest-CreateVolumesFromSnapshotTest-658872456 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:57:25 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-c72f8b58-e1bc-43a7-ac4e-50d5da4ab953 tempest-CreateVolumesFromSnapshotTest-658872456 None] Deleted volume successfully. Apr 28 05:57:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c72f8b58-e1bc-43a7-ac4e-50d5da4ab953 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-618e8069-5f19-4f31-bec2-3713eb898041-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c4a72aed-045e-49ac-8625-23ec51a0c519 tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "cinder-d976df67-9046-4018-aea1-4b7b2054699c-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c4a72aed-045e-49ac-8625-23ec51a0c519 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-d976df67-9046-4018-aea1-4b7b2054699c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c4a72aed-045e-49ac-8625-23ec51a0c519 tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "cinder-quobyte-d976df67-9046-4018-aea1-4b7b2054699c" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c4a72aed-045e-49ac-8625-23ec51a0c519 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-quobyte-d976df67-9046-4018-aea1-4b7b2054699c" acquired by "delete_volume" :: waited 0.020s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:25 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c75bf8-3cb4-4cef-9ca1-5826a12e22eb]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c4a72aed-045e-49ac-8625-23ec51a0c519 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d976df67-9046-4018-aea1-4b7b2054699c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:25 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d976df67-9046-4018-aea1-4b7b2054699c Apr 28 05:57:25 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Flow 'volume_create_manager' (b05ac216-41da-4bfb-814d-8ccdef936267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca92bee6-5b6e-4c69-9db3-7f878cdac0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca92bee6-5b6e-4c69-9db3-7f878cdac0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1631839275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5599af60-3f02-475d-9d8c-02737672b6f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8d447cd2ad24e3081ce3b9e619ac61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:26Z,use_quota=True,user_id='3ca5d96f6b63489ea0a5016d11c8b9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3b952a-11d6-41c8-8cf3-b467fe586d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3b952a-11d6-41c8-8cf3-b467fe586d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8645527-af28-4b79-9563-4cf66440b6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8645527-af28-4b79-9563-4cf66440b6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5599af60-3f02-475d-9d8c-02737672b6f8', 'volume_name': 'volume-5599af60-3f02-475d-9d8c-02737672b6f8', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d5bfb9-d69d-495d-a303-59a6e5e773f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d5bfb9-d69d-495d-a303-59a6e5e773f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a01a7b-b927-4351-b0f8-e580c765cec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:26 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Volume 5599af60-3f02-475d-9d8c-02737672b6f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5599af60-3f02-475d-9d8c-02737672b6f8', 'volume_size': 1} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1631839275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5599af60-3f02-475d-9d8c-02737672b6f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8d447cd2ad24e3081ce3b9e619ac61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:26Z,use_quota=True,user_id='3ca5d96f6b63489ea0a5016d11c8b9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Creating volume 5599af60-3f02-475d-9d8c-02737672b6f8 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:57:26 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5599af60-3f02-475d-9d8c-02737672b6f8 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:26 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c4a72aed-045e-49ac-8625-23ec51a0c519 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d976df67-9046-4018-aea1-4b7b2054699c" returned: 0 in 0.573s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c4a72aed-045e-49ac-8625-23ec51a0c519 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d976df67-9046-4018-aea1-4b7b2054699c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:26 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5599af60-3f02-475d-9d8c-02737672b6f8 1073741824 Apr 28 05:57:26 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:26 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d976df67-9046-4018-aea1-4b7b2054699c Apr 28 05:57:26 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:26 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c4a72aed-045e-49ac-8625-23ec51a0c519 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-d976df67-9046-4018-aea1-4b7b2054699c" returned: 0 in 0.480s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c4a72aed-045e-49ac-8625-23ec51a0c519 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-quobyte-d976df67-9046-4018-aea1-4b7b2054699c" released by "delete_volume" :: held 1.097s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-c4a72aed-045e-49ac-8625-23ec51a0c519 tempest-CreateVolumesFromSnapshotTest-658872456 None] Created reservations ['a02139db-c7d3-4a66-b091-98303eaab431', 'd1657ced-dec5-48b1-b68d-e87045bde2b5', 'dcab9c63-a0a7-4c41-9c6c-f1c7bdd8475e', 'e24f3cfe-502d-4dc4-8479-2dded74c947b'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c4a72aed-045e-49ac-8625-23ec51a0c519 tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c4a72aed-045e-49ac-8625-23ec51a0c519 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c4a72aed-045e-49ac-8625-23ec51a0c519 tempest-CreateVolumesFromSnapshotTest-658872456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:26 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c4a72aed-045e-49ac-8625-23ec51a0c519 tempest-CreateVolumesFromSnapshotTest-658872456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c4a72aed-045e-49ac-8625-23ec51a0c519 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c4a72aed-045e-49ac-8625-23ec51a0c519 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5599af60-3f02-475d-9d8c-02737672b6f8 1073741824" returned: 0 in 0.623s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:26 devstack sudo[89916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:57:26 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5599af60-3f02-475d-9d8c-02737672b6f8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:26 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5599af60-3f02-475d-9d8c-02737672b6f8 Apr 28 05:57:26 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:27 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c4a72aed-045e-49ac-8625-23ec51a0c519 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.457s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:27 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-c4a72aed-045e-49ac-8625-23ec51a0c519 tempest-CreateVolumesFromSnapshotTest-658872456 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:57:27 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-c4a72aed-045e-49ac-8625-23ec51a0c519 tempest-CreateVolumesFromSnapshotTest-658872456 None] Deleted volume successfully. Apr 28 05:57:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-c4a72aed-045e-49ac-8625-23ec51a0c519 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-d976df67-9046-4018-aea1-4b7b2054699c-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:27 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5599af60-3f02-475d-9d8c-02737672b6f8" returned: 0 in 0.459s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:27 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:57:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a01a7b-b927-4351-b0f8-e580c765cec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5599af60-3f02-475d-9d8c-02737672b6f8', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881c54d9-8761-47ee-91e8-2f085d7490ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:27 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Volume volume-5599af60-3f02-475d-9d8c-02737672b6f8 (5599af60-3f02-475d-9d8c-02737672b6f8): created successfully Apr 28 05:57:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881c54d9-8761-47ee-91e8-2f085d7490ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:27 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Flow 'volume_create_manager' (b05ac216-41da-4bfb-814d-8ccdef936267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:27 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-4e1fb339-67ba-454a-88ec-d839449205d4 tempest-VolumesListTestJSON-1546812379 None] Created volume successfully. Apr 28 05:57:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-eb934da8-1306-4b6f-8904-a1fc819b2840 tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "cinder-5fbcd6be-2556-4932-bc59-b959f3190570-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-eb934da8-1306-4b6f-8904-a1fc819b2840 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-5fbcd6be-2556-4932-bc59-b959f3190570-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-eb934da8-1306-4b6f-8904-a1fc819b2840 tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "cinder-quobyte-5fbcd6be-2556-4932-bc59-b959f3190570" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-eb934da8-1306-4b6f-8904-a1fc819b2840 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-quobyte-5fbcd6be-2556-4932-bc59-b959f3190570" acquired by "delete_volume" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:27 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[756931dc-1291-4dd4-a78c-ee461aa8c2f6]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-eb934da8-1306-4b6f-8904-a1fc819b2840 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5fbcd6be-2556-4932-bc59-b959f3190570 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:27 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5fbcd6be-2556-4932-bc59-b959f3190570 Apr 28 05:57:27 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:28 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-eb934da8-1306-4b6f-8904-a1fc819b2840 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5fbcd6be-2556-4932-bc59-b959f3190570" returned: 0 in 0.534s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-eb934da8-1306-4b6f-8904-a1fc819b2840 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5fbcd6be-2556-4932-bc59-b959f3190570 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:28 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5fbcd6be-2556-4932-bc59-b959f3190570 Apr 28 05:57:28 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Flow 'volume_create_manager' (620b1670-32ee-4c82-a5fd-1ce742364dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf4eccb-eca0-4de1-a1b9-096059992394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf4eccb-eca0-4de1-a1b9-096059992394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-62897496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d31098-73a8-4801-8ff6-4ea07bdf4422,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8d447cd2ad24e3081ce3b9e619ac61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:29Z,use_quota=True,user_id='3ca5d96f6b63489ea0a5016d11c8b9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06812f7e-d0f5-4aa9-93be-c51e7777af7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06812f7e-d0f5-4aa9-93be-c51e7777af7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7711dc2a-4ea2-4a79-8e7c-f584b3e52c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7711dc2a-4ea2-4a79-8e7c-f584b3e52c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59d31098-73a8-4801-8ff6-4ea07bdf4422', 'volume_name': 'volume-59d31098-73a8-4801-8ff6-4ea07bdf4422', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a322639-4bfc-4d5b-bdaa-070338f46a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a322639-4bfc-4d5b-bdaa-070338f46a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (638d6d15-f536-41d6-9e78-4ac5f5ca9b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:28 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Volume 59d31098-73a8-4801-8ff6-4ea07bdf4422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59d31098-73a8-4801-8ff6-4ea07bdf4422', 'volume_size': 1} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-62897496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d31098-73a8-4801-8ff6-4ea07bdf4422,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8d447cd2ad24e3081ce3b9e619ac61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:29Z,use_quota=True,user_id='3ca5d96f6b63489ea0a5016d11c8b9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Creating volume 59d31098-73a8-4801-8ff6-4ea07bdf4422 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:57:28 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-59d31098-73a8-4801-8ff6-4ea07bdf4422 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:28 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-59d31098-73a8-4801-8ff6-4ea07bdf4422 1073741824 Apr 28 05:57:28 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:28 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-eb934da8-1306-4b6f-8904-a1fc819b2840 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5fbcd6be-2556-4932-bc59-b959f3190570" returned: 0 in 0.464s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-eb934da8-1306-4b6f-8904-a1fc819b2840 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-quobyte-5fbcd6be-2556-4932-bc59-b959f3190570" released by "delete_volume" :: held 1.041s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-eb934da8-1306-4b6f-8904-a1fc819b2840 tempest-CreateVolumesFromSnapshotTest-658872456 None] Created reservations ['32cffbda-0de8-4628-9d06-052966dab2dd', 'b4f072a5-f0fd-4ad0-b0c2-8bef2e9e5377', 'd8e827ff-f6ba-4dd2-bfdb-ebcc0f14fe03', '654de25a-aeae-4885-bf2e-4a9d9061009f'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-eb934da8-1306-4b6f-8904-a1fc819b2840 tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-eb934da8-1306-4b6f-8904-a1fc819b2840 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-eb934da8-1306-4b6f-8904-a1fc819b2840 tempest-CreateVolumesFromSnapshotTest-658872456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-eb934da8-1306-4b6f-8904-a1fc819b2840 tempest-CreateVolumesFromSnapshotTest-658872456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-eb934da8-1306-4b6f-8904-a1fc819b2840 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-eb934da8-1306-4b6f-8904-a1fc819b2840 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:29 devstack sudo[89932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:57:29 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:29 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-59d31098-73a8-4801-8ff6-4ea07bdf4422 1073741824" returned: 0 in 0.601s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-59d31098-73a8-4801-8ff6-4ea07bdf4422 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:29 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-59d31098-73a8-4801-8ff6-4ea07bdf4422 Apr 28 05:57:29 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:29 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-eb934da8-1306-4b6f-8904-a1fc819b2840 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.501s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:29 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-eb934da8-1306-4b6f-8904-a1fc819b2840 tempest-CreateVolumesFromSnapshotTest-658872456 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:57:29 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-eb934da8-1306-4b6f-8904-a1fc819b2840 tempest-CreateVolumesFromSnapshotTest-658872456 None] Deleted volume successfully. Apr 28 05:57:29 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-eb934da8-1306-4b6f-8904-a1fc819b2840 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-5fbcd6be-2556-4932-bc59-b959f3190570-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:29 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-59d31098-73a8-4801-8ff6-4ea07bdf4422" returned: 0 in 0.449s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:57:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (638d6d15-f536-41d6-9e78-4ac5f5ca9b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59d31098-73a8-4801-8ff6-4ea07bdf4422', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4ca332-aae7-4a0f-ae12-bcdbb10a01a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:29 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Volume volume-59d31098-73a8-4801-8ff6-4ea07bdf4422 (59d31098-73a8-4801-8ff6-4ea07bdf4422): created successfully Apr 28 05:57:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4ca332-aae7-4a0f-ae12-bcdbb10a01a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Flow 'volume_create_manager' (620b1670-32ee-4c82-a5fd-1ce742364dae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:29 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-67b050e7-cad5-4164-97f5-236a8e0b98b3 tempest-VolumesListTestJSON-1546812379 None] Created volume successfully. Apr 28 05:57:29 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-900485c2-ca06-4b79-9bfd-b931eb478fa2 tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "cinder-fde0e029-d541-44e6-8208-75a73cda1074-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-900485c2-ca06-4b79-9bfd-b931eb478fa2 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-fde0e029-d541-44e6-8208-75a73cda1074-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-900485c2-ca06-4b79-9bfd-b931eb478fa2 tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "cinder-quobyte-fde0e029-d541-44e6-8208-75a73cda1074" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-900485c2-ca06-4b79-9bfd-b931eb478fa2 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-quobyte-fde0e029-d541-44e6-8208-75a73cda1074" acquired by "delete_volume" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:30 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fdbb57-7fdb-4653-aab0-82b91bae32d5]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-900485c2-ca06-4b79-9bfd-b931eb478fa2 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fde0e029-d541-44e6-8208-75a73cda1074 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:30 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fde0e029-d541-44e6-8208-75a73cda1074 Apr 28 05:57:30 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:30 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-900485c2-ca06-4b79-9bfd-b931eb478fa2 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fde0e029-d541-44e6-8208-75a73cda1074" returned: 0 in 0.534s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-900485c2-ca06-4b79-9bfd-b931eb478fa2 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fde0e029-d541-44e6-8208-75a73cda1074 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:30 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fde0e029-d541-44e6-8208-75a73cda1074 Apr 28 05:57:30 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Flow 'volume_create_manager' (a253cbc1-dc0f-41b9-80cc-8671d4730ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd51eaf-21f3-48c9-8c4a-05e18d0c438d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:31 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-900485c2-ca06-4b79-9bfd-b931eb478fa2 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-fde0e029-d541-44e6-8208-75a73cda1074" returned: 0 in 0.500s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-900485c2-ca06-4b79-9bfd-b931eb478fa2 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-quobyte-fde0e029-d541-44e6-8208-75a73cda1074" released by "delete_volume" :: held 1.081s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd51eaf-21f3-48c9-8c4a-05e18d0c438d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-406898288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ae66d0-2157-4c17-bf1d-dafb9fd81c2d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8d447cd2ad24e3081ce3b9e619ac61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:31Z,use_quota=True,user_id='3ca5d96f6b63489ea0a5016d11c8b9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f3ad965-f480-4221-b382-0c64c1bb8262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f3ad965-f480-4221-b382-0c64c1bb8262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0daaad38-397e-40ec-92b8-87ed14dcc7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0daaad38-397e-40ec-92b8-87ed14dcc7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54ae66d0-2157-4c17-bf1d-dafb9fd81c2d', 'volume_name': 'volume-54ae66d0-2157-4c17-bf1d-dafb9fd81c2d', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3d5240-da2f-48ae-9cb5-4f80f57a986c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3d5240-da2f-48ae-9cb5-4f80f57a986c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4098826d-ec8e-43a4-8a2f-fbe8c9b3971d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:31 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Volume 54ae66d0-2157-4c17-bf1d-dafb9fd81c2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54ae66d0-2157-4c17-bf1d-dafb9fd81c2d', 'volume_size': 1} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-406898288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ae66d0-2157-4c17-bf1d-dafb9fd81c2d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8d447cd2ad24e3081ce3b9e619ac61e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:31Z,use_quota=True,user_id='3ca5d96f6b63489ea0a5016d11c8b9b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Creating volume 54ae66d0-2157-4c17-bf1d-dafb9fd81c2d {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:57:31 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-54ae66d0-2157-4c17-bf1d-dafb9fd81c2d 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:31 devstack sudo[89950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-54ae66d0-2157-4c17-bf1d-dafb9fd81c2d 1073741824 Apr 28 05:57:31 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-900485c2-ca06-4b79-9bfd-b931eb478fa2 tempest-CreateVolumesFromSnapshotTest-658872456 None] Created reservations ['cc887ef7-ec4b-4a6d-9b2b-142c5113e6ab', '5fd6af50-e1b4-456c-b445-592e6c7df010', 'a38e743b-c030-4cd5-a050-8033071e4184', 'b2ae8de6-568c-435d-8d3f-e790fa1f4d23'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-900485c2-ca06-4b79-9bfd-b931eb478fa2 tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-900485c2-ca06-4b79-9bfd-b931eb478fa2 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-900485c2-ca06-4b79-9bfd-b931eb478fa2 tempest-CreateVolumesFromSnapshotTest-658872456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-900485c2-ca06-4b79-9bfd-b931eb478fa2 tempest-CreateVolumesFromSnapshotTest-658872456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-900485c2-ca06-4b79-9bfd-b931eb478fa2 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-900485c2-ca06-4b79-9bfd-b931eb478fa2 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:31 devstack sudo[89952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:57:31 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:31 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-54ae66d0-2157-4c17-bf1d-dafb9fd81c2d 1073741824" returned: 0 in 0.596s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:31 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-900485c2-ca06-4b79-9bfd-b931eb478fa2 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.509s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-900485c2-ca06-4b79-9bfd-b931eb478fa2 tempest-CreateVolumesFromSnapshotTest-658872456 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-54ae66d0-2157-4c17-bf1d-dafb9fd81c2d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:31 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-900485c2-ca06-4b79-9bfd-b931eb478fa2 tempest-CreateVolumesFromSnapshotTest-658872456 None] Deleted volume successfully. Apr 28 05:57:31 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-54ae66d0-2157-4c17-bf1d-dafb9fd81c2d Apr 28 05:57:31 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:31 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-900485c2-ca06-4b79-9bfd-b931eb478fa2 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-fde0e029-d541-44e6-8208-75a73cda1074-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:32 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-69b60aa7-6c0a-4b21-8a91-bfe2f0afa2f0 tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "cinder-0e508c66-6330-49f7-89cc-3092b5658620-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:32 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-69b60aa7-6c0a-4b21-8a91-bfe2f0afa2f0 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-0e508c66-6330-49f7-89cc-3092b5658620-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:32 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-69b60aa7-6c0a-4b21-8a91-bfe2f0afa2f0 tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "cinder-quobyte-0e508c66-6330-49f7-89cc-3092b5658620" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:32 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-69b60aa7-6c0a-4b21-8a91-bfe2f0afa2f0 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-quobyte-0e508c66-6330-49f7-89cc-3092b5658620" acquired by "delete_volume" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:32 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f456d1-18e4-4902-872f-2c78514596d5]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-69b60aa7-6c0a-4b21-8a91-bfe2f0afa2f0 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e508c66-6330-49f7-89cc-3092b5658620 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:32 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-54ae66d0-2157-4c17-bf1d-dafb9fd81c2d" returned: 0 in 0.498s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:32 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:57:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:32 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4098826d-ec8e-43a4-8a2f-fbe8c9b3971d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54ae66d0-2157-4c17-bf1d-dafb9fd81c2d', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:32 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba60f991-a85d-4f89-b7ff-2b943dcc367a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:32 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Volume volume-54ae66d0-2157-4c17-bf1d-dafb9fd81c2d (54ae66d0-2157-4c17-bf1d-dafb9fd81c2d): created successfully Apr 28 05:57:32 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba60f991-a85d-4f89-b7ff-2b943dcc367a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:32 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Flow 'volume_create_manager' (a253cbc1-dc0f-41b9-80cc-8671d4730ecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:32 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-a28ee55d-642e-473c-93d9-19b477271db0 tempest-VolumesListTestJSON-1546812379 None] Created volume successfully. Apr 28 05:57:32 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e508c66-6330-49f7-89cc-3092b5658620 Apr 28 05:57:32 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:32 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-69b60aa7-6c0a-4b21-8a91-bfe2f0afa2f0 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e508c66-6330-49f7-89cc-3092b5658620" returned: 0 in 0.518s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-69b60aa7-6c0a-4b21-8a91-bfe2f0afa2f0 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e508c66-6330-49f7-89cc-3092b5658620 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:32 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e508c66-6330-49f7-89cc-3092b5658620 Apr 28 05:57:32 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:33 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-69b60aa7-6c0a-4b21-8a91-bfe2f0afa2f0 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e508c66-6330-49f7-89cc-3092b5658620" returned: 0 in 0.461s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:33 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-69b60aa7-6c0a-4b21-8a91-bfe2f0afa2f0 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-quobyte-0e508c66-6330-49f7-89cc-3092b5658620" released by "delete_volume" :: held 1.025s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:33 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-69b60aa7-6c0a-4b21-8a91-bfe2f0afa2f0 tempest-CreateVolumesFromSnapshotTest-658872456 None] Created reservations ['ecda0422-4996-42cb-a069-e9a88023ff7d', '0624d26c-7e55-4338-aa75-a67d14c0b0a2', 'a32516c8-2150-47c9-9641-289858b5fd26', 'bc1bb52d-17d0-4f80-a9c3-25f2f4bafb3b'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:57:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-69b60aa7-6c0a-4b21-8a91-bfe2f0afa2f0 tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-69b60aa7-6c0a-4b21-8a91-bfe2f0afa2f0 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-69b60aa7-6c0a-4b21-8a91-bfe2f0afa2f0 tempest-CreateVolumesFromSnapshotTest-658872456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-69b60aa7-6c0a-4b21-8a91-bfe2f0afa2f0 tempest-CreateVolumesFromSnapshotTest-658872456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-69b60aa7-6c0a-4b21-8a91-bfe2f0afa2f0 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-69b60aa7-6c0a-4b21-8a91-bfe2f0afa2f0 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:33 devstack sudo[89969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:57:33 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:33 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-69b60aa7-6c0a-4b21-8a91-bfe2f0afa2f0 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.478s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:33 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-69b60aa7-6c0a-4b21-8a91-bfe2f0afa2f0 tempest-CreateVolumesFromSnapshotTest-658872456 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:57:33 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-69b60aa7-6c0a-4b21-8a91-bfe2f0afa2f0 tempest-CreateVolumesFromSnapshotTest-658872456 None] Deleted volume successfully. Apr 28 05:57:33 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-69b60aa7-6c0a-4b21-8a91-bfe2f0afa2f0 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-0e508c66-6330-49f7-89cc-3092b5658620-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-95cc83e1-40b0-42db-8c43-b12e7723d2b6 tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "cinder-8c3c08f3-dc88-422b-9042-34044d735406-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-95cc83e1-40b0-42db-8c43-b12e7723d2b6 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-8c3c08f3-dc88-422b-9042-34044d735406-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-95cc83e1-40b0-42db-8c43-b12e7723d2b6 tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "cinder-quobyte-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-95cc83e1-40b0-42db-8c43-b12e7723d2b6 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-quobyte-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-95cc83e1-40b0-42db-8c43-b12e7723d2b6 tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "cinder-quobyte-8c3c08f3-dc88-422b-9042-34044d735406" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-95cc83e1-40b0-42db-8c43-b12e7723d2b6 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-quobyte-8c3c08f3-dc88-422b-9042-34044d735406" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:34 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-95cc83e1-40b0-42db-8c43-b12e7723d2b6 tempest-CreateVolumesFromSnapshotTest-658872456 None] Deleting offline snapshot 8c3c08f3-dc88-422b-9042-34044d735406 of volume 183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:57:34 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-95cc83e1-40b0-42db-8c43-b12e7723d2b6 tempest-CreateVolumesFromSnapshotTest-658872456 None] snapshot_file for this snap is: volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.8c3c08f3-dc88-422b-9042-34044d735406 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:57:34 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1ebe29-3d26-4a28-9dbf-114885f237d5]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-95cc83e1-40b0-42db-8c43-b12e7723d2b6 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.8c3c08f3-dc88-422b-9042-34044d735406 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:34 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.8c3c08f3-dc88-422b-9042-34044d735406 Apr 28 05:57:34 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:35 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-95cc83e1-40b0-42db-8c43-b12e7723d2b6 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.8c3c08f3-dc88-422b-9042-34044d735406" returned: 0 in 0.587s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:35 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-95cc83e1-40b0-42db-8c43-b12e7723d2b6 tempest-CreateVolumesFromSnapshotTest-658872456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:57:35 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea46e3ed-94c7-4cfc-8701-29230043d615]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-95cc83e1-40b0-42db-8c43-b12e7723d2b6 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:35 devstack sudo[89977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31 Apr 28 05:57:35 devstack sudo[89977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:35 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ef975cfd-2cee-4e80-b259-85fb48054b3c tempest-VolumesListTestJSON-1546812379 None] Acquiring lock "cinder-54ae66d0-2157-4c17-bf1d-dafb9fd81c2d-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:35 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ef975cfd-2cee-4e80-b259-85fb48054b3c tempest-VolumesListTestJSON-1546812379 None] Lock "cinder-54ae66d0-2157-4c17-bf1d-dafb9fd81c2d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:35 devstack sudo[89977]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:35 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ef975cfd-2cee-4e80-b259-85fb48054b3c tempest-VolumesListTestJSON-1546812379 None] Acquiring lock "cinder-quobyte-54ae66d0-2157-4c17-bf1d-dafb9fd81c2d" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-95cc83e1-40b0-42db-8c43-b12e7723d2b6 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31" returned: 0 in 0.555s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-95cc83e1-40b0-42db-8c43-b12e7723d2b6 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.8c3c08f3-dc88-422b-9042-34044d735406 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:35 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ef975cfd-2cee-4e80-b259-85fb48054b3c tempest-VolumesListTestJSON-1546812379 None] Lock "cinder-quobyte-54ae66d0-2157-4c17-bf1d-dafb9fd81c2d" acquired by "delete_volume" :: waited 0.031s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:35 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.8c3c08f3-dc88-422b-9042-34044d735406 Apr 28 05:57:35 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:35 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f27d7c4-18b9-480f-a4fa-5a82c0b56d8b]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ef975cfd-2cee-4e80-b259-85fb48054b3c tempest-VolumesListTestJSON-1546812379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-54ae66d0-2157-4c17-bf1d-dafb9fd81c2d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:35 devstack sudo[89984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-54ae66d0-2157-4c17-bf1d-dafb9fd81c2d Apr 28 05:57:35 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:36 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-95cc83e1-40b0-42db-8c43-b12e7723d2b6 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.8c3c08f3-dc88-422b-9042-34044d735406" returned: 0 in 0.571s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-95cc83e1-40b0-42db-8c43-b12e7723d2b6 tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.8c3c08f3-dc88-422b-9042-34044d735406 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:36 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ef975cfd-2cee-4e80-b259-85fb48054b3c tempest-VolumesListTestJSON-1546812379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-54ae66d0-2157-4c17-bf1d-dafb9fd81c2d" returned: 0 in 0.543s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ef975cfd-2cee-4e80-b259-85fb48054b3c tempest-VolumesListTestJSON-1546812379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-54ae66d0-2157-4c17-bf1d-dafb9fd81c2d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:36 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.8c3c08f3-dc88-422b-9042-34044d735406 Apr 28 05:57:36 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:36 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-54ae66d0-2157-4c17-bf1d-dafb9fd81c2d Apr 28 05:57:36 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:36 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-95cc83e1-40b0-42db-8c43-b12e7723d2b6 tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31.8c3c08f3-dc88-422b-9042-34044d735406" returned: 0 in 0.463s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:36 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:36 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:SELECT=133,cinder:INSERT=42,cinder:UPDATE=177,cinder:DELETE=16 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:57:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ef975cfd-2cee-4e80-b259-85fb48054b3c tempest-VolumesListTestJSON-1546812379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-54ae66d0-2157-4c17-bf1d-dafb9fd81c2d" returned: 0 in 0.462s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ef975cfd-2cee-4e80-b259-85fb48054b3c tempest-VolumesListTestJSON-1546812379 None] Lock "cinder-quobyte-54ae66d0-2157-4c17-bf1d-dafb9fd81c2d" released by "delete_volume" :: held 1.069s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-95cc83e1-40b0-42db-8c43-b12e7723d2b6 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-quobyte-8c3c08f3-dc88-422b-9042-34044d735406" released by "_delete_snapshot" :: held 2.307s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-95cc83e1-40b0-42db-8c43-b12e7723d2b6 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-quobyte-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31" released by "delete_snapshot" :: held 2.339s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:36 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-ef975cfd-2cee-4e80-b259-85fb48054b3c tempest-VolumesListTestJSON-1546812379 None] Created reservations ['2112c045-eb77-4239-978d-c3261b539ac6', '40a8dcfd-8c3c-49d6-9b2a-1b60350c55be', '6f03171f-35f8-4719-b5aa-424a755f0308', '89f1e227-6aea-4b3d-af9e-47edc9baa330'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:57:36 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-95cc83e1-40b0-42db-8c43-b12e7723d2b6 tempest-CreateVolumesFromSnapshotTest-658872456 None] Created reservations ['092f900d-0c3f-4fd6-af44-86b6645107ff', 'a8becc08-327c-4e36-9d91-bbc0aff36097', 'a795426c-e2c9-4bcf-8194-0099fed4f328', '684f52c8-3dd9-4c25-96b4-9bd9703b6f23'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:57:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ef975cfd-2cee-4e80-b259-85fb48054b3c tempest-VolumesListTestJSON-1546812379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ef975cfd-2cee-4e80-b259-85fb48054b3c tempest-VolumesListTestJSON-1546812379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:36 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ef975cfd-2cee-4e80-b259-85fb48054b3c tempest-VolumesListTestJSON-1546812379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:36 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ef975cfd-2cee-4e80-b259-85fb48054b3c tempest-VolumesListTestJSON-1546812379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ef975cfd-2cee-4e80-b259-85fb48054b3c tempest-VolumesListTestJSON-1546812379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ef975cfd-2cee-4e80-b259-85fb48054b3c tempest-VolumesListTestJSON-1546812379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:36 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:57:36 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:36 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-95cc83e1-40b0-42db-8c43-b12e7723d2b6 tempest-CreateVolumesFromSnapshotTest-658872456 None] Delete snapshot completed successfully. Apr 28 05:57:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-95cc83e1-40b0-42db-8c43-b12e7723d2b6 tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-8c3c08f3-dc88-422b-9042-34044d735406-delete_snapshot" released by "delete_snapshot" :: held 2.545s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:37 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ef975cfd-2cee-4e80-b259-85fb48054b3c tempest-VolumesListTestJSON-1546812379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.443s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:37 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-ef975cfd-2cee-4e80-b259-85fb48054b3c tempest-VolumesListTestJSON-1546812379 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:57:37 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-ef975cfd-2cee-4e80-b259-85fb48054b3c tempest-VolumesListTestJSON-1546812379 None] Deleted volume successfully. Apr 28 05:57:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ef975cfd-2cee-4e80-b259-85fb48054b3c tempest-VolumesListTestJSON-1546812379 None] Lock "cinder-54ae66d0-2157-4c17-bf1d-dafb9fd81c2d-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-dbae1470-07f2-48bb-9577-a9eda378bdfd tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "cinder-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-dbae1470-07f2-48bb-9577-a9eda378bdfd tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-dbae1470-07f2-48bb-9577-a9eda378bdfd tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "cinder-quobyte-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-dbae1470-07f2-48bb-9577-a9eda378bdfd tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-quobyte-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31" acquired by "delete_volume" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:37 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4f9134-2056-4cc3-98a1-a732c8208a18]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dbae1470-07f2-48bb-9577-a9eda378bdfd tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:37 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31 Apr 28 05:57:37 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0681ff45-99d6-4e90-8131-ebfece602403 tempest-VolumesListTestJSON-1546812379 None] Acquiring lock "cinder-59d31098-73a8-4801-8ff6-4ea07bdf4422-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0681ff45-99d6-4e90-8131-ebfece602403 tempest-VolumesListTestJSON-1546812379 None] Lock "cinder-59d31098-73a8-4801-8ff6-4ea07bdf4422-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0681ff45-99d6-4e90-8131-ebfece602403 tempest-VolumesListTestJSON-1546812379 None] Acquiring lock "cinder-quobyte-59d31098-73a8-4801-8ff6-4ea07bdf4422" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0681ff45-99d6-4e90-8131-ebfece602403 tempest-VolumesListTestJSON-1546812379 None] Lock "cinder-quobyte-59d31098-73a8-4801-8ff6-4ea07bdf4422" acquired by "delete_volume" :: waited 0.013s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:37 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b27a665-47de-4811-8bf4-7a1f578ecb7c]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0681ff45-99d6-4e90-8131-ebfece602403 tempest-VolumesListTestJSON-1546812379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-59d31098-73a8-4801-8ff6-4ea07bdf4422 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:38 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-59d31098-73a8-4801-8ff6-4ea07bdf4422 Apr 28 05:57:38 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:38 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dbae1470-07f2-48bb-9577-a9eda378bdfd tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31" returned: 0 in 0.538s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dbae1470-07f2-48bb-9577-a9eda378bdfd tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:38 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31 Apr 28 05:57:38 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:38 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0681ff45-99d6-4e90-8131-ebfece602403 tempest-VolumesListTestJSON-1546812379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-59d31098-73a8-4801-8ff6-4ea07bdf4422" returned: 0 in 0.530s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0681ff45-99d6-4e90-8131-ebfece602403 tempest-VolumesListTestJSON-1546812379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-59d31098-73a8-4801-8ff6-4ea07bdf4422 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:38 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-59d31098-73a8-4801-8ff6-4ea07bdf4422 Apr 28 05:57:38 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:38 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dbae1470-07f2-48bb-9577-a9eda378bdfd tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31" returned: 0 in 0.459s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:38 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-dbae1470-07f2-48bb-9577-a9eda378bdfd tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-quobyte-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31" released by "delete_volume" :: held 1.066s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:38 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-dbae1470-07f2-48bb-9577-a9eda378bdfd tempest-CreateVolumesFromSnapshotTest-658872456 None] Created reservations ['8ad1c82f-6a69-4719-91ad-6977feef46eb', '88142225-c7a8-4bf8-8a37-f6c4524f080e', '176ca728-5fd3-4831-b9f6-fe85b6b01cee', 'c38aecf7-3d5e-49cb-8e3d-535a05ca4d5f'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:57:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dbae1470-07f2-48bb-9577-a9eda378bdfd tempest-CreateVolumesFromSnapshotTest-658872456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dbae1470-07f2-48bb-9577-a9eda378bdfd tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:38 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dbae1470-07f2-48bb-9577-a9eda378bdfd tempest-CreateVolumesFromSnapshotTest-658872456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:38 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dbae1470-07f2-48bb-9577-a9eda378bdfd tempest-CreateVolumesFromSnapshotTest-658872456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dbae1470-07f2-48bb-9577-a9eda378bdfd tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dbae1470-07f2-48bb-9577-a9eda378bdfd tempest-CreateVolumesFromSnapshotTest-658872456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:38 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:57:38 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:38 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0681ff45-99d6-4e90-8131-ebfece602403 tempest-VolumesListTestJSON-1546812379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-59d31098-73a8-4801-8ff6-4ea07bdf4422" returned: 0 in 0.457s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:38 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0681ff45-99d6-4e90-8131-ebfece602403 tempest-VolumesListTestJSON-1546812379 None] Lock "cinder-quobyte-59d31098-73a8-4801-8ff6-4ea07bdf4422" released by "delete_volume" :: held 1.030s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:39 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-0681ff45-99d6-4e90-8131-ebfece602403 tempest-VolumesListTestJSON-1546812379 None] Created reservations ['e4a01fb1-d0ba-4e5c-acd0-478801b888c7', 'cd9cddb4-3afa-4466-b8e3-b2bb39a92e8d', '2cdeb745-ab20-4dff-b12b-f45d41dc9f1f', '3323e723-1ead-49ac-869a-748afa0477ec'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:57:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0681ff45-99d6-4e90-8131-ebfece602403 tempest-VolumesListTestJSON-1546812379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0681ff45-99d6-4e90-8131-ebfece602403 tempest-VolumesListTestJSON-1546812379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:39 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-0681ff45-99d6-4e90-8131-ebfece602403 tempest-VolumesListTestJSON-1546812379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:39 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-0681ff45-99d6-4e90-8131-ebfece602403 tempest-VolumesListTestJSON-1546812379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0681ff45-99d6-4e90-8131-ebfece602403 tempest-VolumesListTestJSON-1546812379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0681ff45-99d6-4e90-8131-ebfece602403 tempest-VolumesListTestJSON-1546812379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:39 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:57:39 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:39 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dbae1470-07f2-48bb-9577-a9eda378bdfd tempest-CreateVolumesFromSnapshotTest-658872456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.471s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:39 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-dbae1470-07f2-48bb-9577-a9eda378bdfd tempest-CreateVolumesFromSnapshotTest-658872456 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:57:39 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-dbae1470-07f2-48bb-9577-a9eda378bdfd tempest-CreateVolumesFromSnapshotTest-658872456 None] Deleted volume successfully. Apr 28 05:57:39 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-dbae1470-07f2-48bb-9577-a9eda378bdfd tempest-CreateVolumesFromSnapshotTest-658872456 None] Lock "cinder-183b7fd9-2ec5-4d2d-9cc7-95bbd7cadd31-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:39 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0681ff45-99d6-4e90-8131-ebfece602403 tempest-VolumesListTestJSON-1546812379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.449s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:39 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-0681ff45-99d6-4e90-8131-ebfece602403 tempest-VolumesListTestJSON-1546812379 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:57:39 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-0681ff45-99d6-4e90-8131-ebfece602403 tempest-VolumesListTestJSON-1546812379 None] Deleted volume successfully. Apr 28 05:57:39 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0681ff45-99d6-4e90-8131-ebfece602403 tempest-VolumesListTestJSON-1546812379 None] Lock "cinder-59d31098-73a8-4801-8ff6-4ea07bdf4422-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-8c8c5954-24c7-4918-945d-1608a8cdd583 tempest-VolumesListTestJSON-1546812379 None] Acquiring lock "cinder-5599af60-3f02-475d-9d8c-02737672b6f8-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-8c8c5954-24c7-4918-945d-1608a8cdd583 tempest-VolumesListTestJSON-1546812379 None] Lock "cinder-5599af60-3f02-475d-9d8c-02737672b6f8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-8c8c5954-24c7-4918-945d-1608a8cdd583 tempest-VolumesListTestJSON-1546812379 None] Acquiring lock "cinder-quobyte-5599af60-3f02-475d-9d8c-02737672b6f8" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-8c8c5954-24c7-4918-945d-1608a8cdd583 tempest-VolumesListTestJSON-1546812379 None] Lock "cinder-quobyte-5599af60-3f02-475d-9d8c-02737672b6f8" acquired by "delete_volume" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:40 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d783dd-fa08-417e-bd6c-3505347328f6]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-8c8c5954-24c7-4918-945d-1608a8cdd583 tempest-VolumesListTestJSON-1546812379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5599af60-3f02-475d-9d8c-02737672b6f8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:40 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5599af60-3f02-475d-9d8c-02737672b6f8 Apr 28 05:57:40 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:40 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-8c8c5954-24c7-4918-945d-1608a8cdd583 tempest-VolumesListTestJSON-1546812379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5599af60-3f02-475d-9d8c-02737672b6f8" returned: 0 in 0.584s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-8c8c5954-24c7-4918-945d-1608a8cdd583 tempest-VolumesListTestJSON-1546812379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5599af60-3f02-475d-9d8c-02737672b6f8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:40 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5599af60-3f02-475d-9d8c-02737672b6f8 Apr 28 05:57:40 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:41 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-8c8c5954-24c7-4918-945d-1608a8cdd583 tempest-VolumesListTestJSON-1546812379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5599af60-3f02-475d-9d8c-02737672b6f8" returned: 0 in 0.474s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:41 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-8c8c5954-24c7-4918-945d-1608a8cdd583 tempest-VolumesListTestJSON-1546812379 None] Lock "cinder-quobyte-5599af60-3f02-475d-9d8c-02737672b6f8" released by "delete_volume" :: held 1.097s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:41 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-8c8c5954-24c7-4918-945d-1608a8cdd583 tempest-VolumesListTestJSON-1546812379 None] Created reservations ['2ea09169-86bb-45fa-8b77-c49a8400cbf6', '79fe1eb4-5a9a-4caa-818f-37c287c04e3d', '5f9c1171-040b-487e-865a-1b297c60288b', '764990f7-da36-442c-a5b4-636b98fcedc5'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:57:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-8c8c5954-24c7-4918-945d-1608a8cdd583 tempest-VolumesListTestJSON-1546812379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-8c8c5954-24c7-4918-945d-1608a8cdd583 tempest-VolumesListTestJSON-1546812379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:41 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-8c8c5954-24c7-4918-945d-1608a8cdd583 tempest-VolumesListTestJSON-1546812379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:41 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-8c8c5954-24c7-4918-945d-1608a8cdd583 tempest-VolumesListTestJSON-1546812379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-8c8c5954-24c7-4918-945d-1608a8cdd583 tempest-VolumesListTestJSON-1546812379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-8c8c5954-24c7-4918-945d-1608a8cdd583 tempest-VolumesListTestJSON-1546812379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:41 devstack sudo[90032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:57:41 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:41 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-8c8c5954-24c7-4918-945d-1608a8cdd583 tempest-VolumesListTestJSON-1546812379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.478s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:41 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-8c8c5954-24c7-4918-945d-1608a8cdd583 tempest-VolumesListTestJSON-1546812379 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:57:41 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-8c8c5954-24c7-4918-945d-1608a8cdd583 tempest-VolumesListTestJSON-1546812379 None] Deleted volume successfully. Apr 28 05:57:41 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-8c8c5954-24c7-4918-945d-1608a8cdd583 tempest-VolumesListTestJSON-1546812379 None] Lock "cinder-5599af60-3f02-475d-9d8c-02737672b6f8-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:SELECT=142,cinder:INSERT=57,cinder:UPDATE=191,cinder:DELETE=14 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Flow 'volume_create_manager' (ec4345fd-5bb7-4655-a58b-b553f4ae9e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a82aa3-22ae-4532-b1e3-02d9c5dd9878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a82aa3-22ae-4532-b1e3-02d9c5dd9878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc0b9e7-ee11-43ea-b549-cbad6bc168f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cae2579579342b0ba2dc763bce713ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:43Z,use_quota=True,user_id='4871865313f641929cd053bb5443f23f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48aaf0d0-c043-4bf3-bee2-7aab6514dba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48aaf0d0-c043-4bf3-bee2-7aab6514dba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549ebc25-b8e9-462a-b979-b19c943e77b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549ebc25-b8e9-462a-b979-b19c943e77b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccc0b9e7-ee11-43ea-b549-cbad6bc168f5', 'volume_name': 'volume-ccc0b9e7-ee11-43ea-b549-cbad6bc168f5', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64e1916-5a24-4e57-9904-df493518eb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64e1916-5a24-4e57-9904-df493518eb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ef9710-bfe0-4772-8d5f-68ec5b9c1992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:42 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Volume ccc0b9e7-ee11-43ea-b549-cbad6bc168f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccc0b9e7-ee11-43ea-b549-cbad6bc168f5', 'volume_size': 1} Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc0b9e7-ee11-43ea-b549-cbad6bc168f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cae2579579342b0ba2dc763bce713ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:43Z,use_quota=True,user_id='4871865313f641929cd053bb5443f23f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Creating volume ccc0b9e7-ee11-43ea-b549-cbad6bc168f5 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:57:42 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:57:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccc0b9e7-ee11-43ea-b549-cbad6bc168f5 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:42 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccc0b9e7-ee11-43ea-b549-cbad6bc168f5 1073741824 Apr 28 05:57:42 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:43 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccc0b9e7-ee11-43ea-b549-cbad6bc168f5 1073741824" returned: 0 in 0.774s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccc0b9e7-ee11-43ea-b549-cbad6bc168f5 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:43 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccc0b9e7-ee11-43ea-b549-cbad6bc168f5 Apr 28 05:57:43 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:43 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccc0b9e7-ee11-43ea-b549-cbad6bc168f5" returned: 0 in 0.517s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:43 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:57:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:43 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ef9710-bfe0-4772-8d5f-68ec5b9c1992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccc0b9e7-ee11-43ea-b549-cbad6bc168f5', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:43 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5d79f8-69b9-4f45-8ef7-d89fcf8cefe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:44 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Volume volume-ccc0b9e7-ee11-43ea-b549-cbad6bc168f5 (ccc0b9e7-ee11-43ea-b549-cbad6bc168f5): created successfully Apr 28 05:57:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5d79f8-69b9-4f45-8ef7-d89fcf8cefe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:44 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Flow 'volume_create_manager' (ec4345fd-5bb7-4655-a58b-b553f4ae9e11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:44 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-3f1b1356-1207-46a5-aa5b-365031e06254 tempest-CinderUnicodeTest-1303163505 None] Created volume successfully. Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Flow 'volume_create_manager' (76429dd3-ae98-45cb-9843-7b8a4b593b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f5947b-dbf5-468f-9570-4ba952f3628a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f5947b-dbf5-468f-9570-4ba952f3628a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1379448884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f467dab-ceeb-436c-b69d-01e90c2a7de8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cae2579579342b0ba2dc763bce713ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:45Z,use_quota=True,user_id='4871865313f641929cd053bb5443f23f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d5fc2ff-38a7-4d2e-9e51-2ac5b8421aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d5fc2ff-38a7-4d2e-9e51-2ac5b8421aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46adc3a4-ed7c-4eb2-b32a-0b2adaf20ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46adc3a4-ed7c-4eb2-b32a-0b2adaf20ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f467dab-ceeb-436c-b69d-01e90c2a7de8', 'volume_name': 'volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71685d18-d2ab-4cd5-856c-3c11a83fa80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71685d18-d2ab-4cd5-856c-3c11a83fa80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa360a2-394f-4cb2-bca0-ebb137c1f522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:45 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Volume 3f467dab-ceeb-436c-b69d-01e90c2a7de8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8', 'volume_size': 1} Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1379448884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f467dab-ceeb-436c-b69d-01e90c2a7de8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cae2579579342b0ba2dc763bce713ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:45Z,use_quota=True,user_id='4871865313f641929cd053bb5443f23f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Creating volume 3f467dab-ceeb-436c-b69d-01e90c2a7de8 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:57:45 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:45 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8 1073741824 Apr 28 05:57:45 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:45 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8 1073741824" returned: 0 in 0.666s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:45 devstack sudo[90048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8 Apr 28 05:57:45 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:46 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8" returned: 0 in 0.508s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:46 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:57:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa360a2-394f-4cb2-bca0-ebb137c1f522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae15c368-0a6f-4f63-8509-309637696192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:46 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Volume volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8 (3f467dab-ceeb-436c-b69d-01e90c2a7de8): created successfully Apr 28 05:57:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae15c368-0a6f-4f63-8509-309637696192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Flow 'volume_create_manager' (76429dd3-ae98-45cb-9843-7b8a4b593b73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:46 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-a4fbab2a-7306-4ea5-af8c-ed1f683e352a tempest-CinderUnicodeTest-1303163505 None] Created volume successfully. Apr 28 05:57:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7942f206-f969-41bf-8347-d946eb9258b9 tempest-CinderUnicodeTest-1303163505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7942f206-f969-41bf-8347-d946eb9258b9 tempest-CinderUnicodeTest-1303163505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:47 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-7942f206-f969-41bf-8347-d946eb9258b9 tempest-CinderUnicodeTest-1303163505 None] Creating offline snapshot eb599997-874a-42ce-bb80-7b90620220c3 of volume 3f467dab-ceeb-436c-b69d-01e90c2a7de8 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:57:47 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23c4dad-7c9f-4a9c-b9f8-2badb215df7c]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7942f206-f969-41bf-8347-d946eb9258b9 tempest-CinderUnicodeTest-1303163505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:47 devstack sudo[90051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8 Apr 28 05:57:47 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:48 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7942f206-f969-41bf-8347-d946eb9258b9 tempest-CinderUnicodeTest-1303163505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8" returned: 0 in 0.516s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7942f206-f969-41bf-8347-d946eb9258b9 tempest-CinderUnicodeTest-1303163505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.eb599997-874a-42ce-bb80-7b90620220c3 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:48 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.eb599997-874a-42ce-bb80-7b90620220c3 1G Apr 28 05:57:48 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:48 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7942f206-f969-41bf-8347-d946eb9258b9 tempest-CinderUnicodeTest-1303163505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.eb599997-874a-42ce-bb80-7b90620220c3 1G" returned: 0 in 0.706s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7942f206-f969-41bf-8347-d946eb9258b9 tempest-CinderUnicodeTest-1303163505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.eb599997-874a-42ce-bb80-7b90620220c3 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:48 devstack sudo[90061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.eb599997-874a-42ce-bb80-7b90620220c3 Apr 28 05:57:48 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:49 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7942f206-f969-41bf-8347-d946eb9258b9 tempest-CinderUnicodeTest-1303163505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.eb599997-874a-42ce-bb80-7b90620220c3" returned: 0 in 0.550s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:49 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-7942f206-f969-41bf-8347-d946eb9258b9 tempest-CinderUnicodeTest-1303163505 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.eb599997-874a-42ce-bb80-7b90620220c3 is being set with open permissions: ugo+rw Apr 28 05:57:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7942f206-f969-41bf-8347-d946eb9258b9 tempest-CinderUnicodeTest-1303163505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.eb599997-874a-42ce-bb80-7b90620220c3 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:49 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.eb599997-874a-42ce-bb80-7b90620220c3 Apr 28 05:57:49 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:49 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7942f206-f969-41bf-8347-d946eb9258b9 tempest-CinderUnicodeTest-1303163505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.eb599997-874a-42ce-bb80-7b90620220c3" returned: 0 in 0.552s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7942f206-f969-41bf-8347-d946eb9258b9 tempest-CinderUnicodeTest-1303163505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:49 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.info Apr 28 05:57:49 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:50 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7942f206-f969-41bf-8347-d946eb9258b9 tempest-CinderUnicodeTest-1303163505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.info" returned: 0 in 0.546s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:50 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-7942f206-f969-41bf-8347-d946eb9258b9 tempest-CinderUnicodeTest-1303163505 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.info is being set with open permissions: ugo+rw Apr 28 05:57:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7942f206-f969-41bf-8347-d946eb9258b9 tempest-CinderUnicodeTest-1303163505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:50 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.info Apr 28 05:57:50 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:50 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7942f206-f969-41bf-8347-d946eb9258b9 tempest-CinderUnicodeTest-1303163505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.info" returned: 0 in 0.484s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7942f206-f969-41bf-8347-d946eb9258b9 tempest-CinderUnicodeTest-1303163505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.461s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:50 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-7942f206-f969-41bf-8347-d946eb9258b9 tempest-CinderUnicodeTest-1303163505 None] Create snapshot completed successfully Apr 28 05:57:51 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e5a35f24-332b-4b7a-947d-bc3814175a85 tempest-CinderUnicodeTest-1303163505 None] Acquiring lock "cinder-eb599997-874a-42ce-bb80-7b90620220c3-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:51 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e5a35f24-332b-4b7a-947d-bc3814175a85 tempest-CinderUnicodeTest-1303163505 None] Lock "cinder-eb599997-874a-42ce-bb80-7b90620220c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:51 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e5a35f24-332b-4b7a-947d-bc3814175a85 tempest-CinderUnicodeTest-1303163505 None] Acquiring lock "cinder-quobyte-3f467dab-ceeb-436c-b69d-01e90c2a7de8" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:51 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e5a35f24-332b-4b7a-947d-bc3814175a85 tempest-CinderUnicodeTest-1303163505 None] Lock "cinder-quobyte-3f467dab-ceeb-436c-b69d-01e90c2a7de8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:51 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e5a35f24-332b-4b7a-947d-bc3814175a85 tempest-CinderUnicodeTest-1303163505 None] Acquiring lock "cinder-quobyte-eb599997-874a-42ce-bb80-7b90620220c3" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:51 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e5a35f24-332b-4b7a-947d-bc3814175a85 tempest-CinderUnicodeTest-1303163505 None] Lock "cinder-quobyte-eb599997-874a-42ce-bb80-7b90620220c3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-e5a35f24-332b-4b7a-947d-bc3814175a85 tempest-CinderUnicodeTest-1303163505 None] Deleting offline snapshot eb599997-874a-42ce-bb80-7b90620220c3 of volume 3f467dab-ceeb-436c-b69d-01e90c2a7de8 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:57:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-e5a35f24-332b-4b7a-947d-bc3814175a85 tempest-CinderUnicodeTest-1303163505 None] snapshot_file for this snap is: volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.eb599997-874a-42ce-bb80-7b90620220c3 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:57:51 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c99b41b-f951-4fd6-8a30-18e6bc4584a2]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e5a35f24-332b-4b7a-947d-bc3814175a85 tempest-CinderUnicodeTest-1303163505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.eb599997-874a-42ce-bb80-7b90620220c3 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:51 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.eb599997-874a-42ce-bb80-7b90620220c3 Apr 28 05:57:51 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Flow 'volume_create_manager' (6ca86aeb-d5db-406b-949a-acfb038e6529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c3645e-5811-4cb0-b10f-42484cfb0c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c3645e-5811-4cb0-b10f-42484cfb0c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1179807404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5cd19e9-f5ab-485a-b42f-ee406c5b376f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2d43cf5d6c4d3e96c2601c1c401fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:52Z,use_quota=True,user_id='8fee681d413e4c708123dcf5962a743b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c99716e-c6d6-4fba-aa6e-75a332b957ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c99716e-c6d6-4fba-aa6e-75a332b957ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51680cde-6a02-43fe-9f6e-21bd3efcece4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51680cde-6a02-43fe-9f6e-21bd3efcece4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5cd19e9-f5ab-485a-b42f-ee406c5b376f', 'volume_name': 'volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b74453-4ee7-483d-b5cd-ac7ff78728c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b74453-4ee7-483d-b5cd-ac7ff78728c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17424b5c-db03-44e0-a2cc-7d4a9d599be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:52 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Volume f5cd19e9-f5ab-485a-b42f-ee406c5b376f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f', 'volume_size': 1} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1179807404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5cd19e9-f5ab-485a-b42f-ee406c5b376f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2d43cf5d6c4d3e96c2601c1c401fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:57:52Z,use_quota=True,user_id='8fee681d413e4c708123dcf5962a743b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Creating volume f5cd19e9-f5ab-485a-b42f-ee406c5b376f {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:57:52 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:52 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f 1073741824 Apr 28 05:57:52 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:52 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e5a35f24-332b-4b7a-947d-bc3814175a85 tempest-CinderUnicodeTest-1303163505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.eb599997-874a-42ce-bb80-7b90620220c3" returned: 0 in 0.588s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-e5a35f24-332b-4b7a-947d-bc3814175a85 tempest-CinderUnicodeTest-1303163505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08f8a8d-33bb-4f0e-8520-784ee391fd78]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e5a35f24-332b-4b7a-947d-bc3814175a85 tempest-CinderUnicodeTest-1303163505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:52 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8 Apr 28 05:57:52 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:53 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e5a35f24-332b-4b7a-947d-bc3814175a85 tempest-CinderUnicodeTest-1303163505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8" returned: 0 in 0.532s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e5a35f24-332b-4b7a-947d-bc3814175a85 tempest-CinderUnicodeTest-1303163505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.eb599997-874a-42ce-bb80-7b90620220c3 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:53 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f 1073741824" returned: 0 in 0.644s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:53 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.eb599997-874a-42ce-bb80-7b90620220c3 Apr 28 05:57:53 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:53 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f Apr 28 05:57:53 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:53 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f" returned: 0 in 0.476s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:53 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:57:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:53 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17424b5c-db03-44e0-a2cc-7d4a9d599be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:53 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7d2ac9-7945-4d0f-a38a-ffc8ee4dfd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:57:53 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e5a35f24-332b-4b7a-947d-bc3814175a85 tempest-CinderUnicodeTest-1303163505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.eb599997-874a-42ce-bb80-7b90620220c3" returned: 0 in 0.553s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e5a35f24-332b-4b7a-947d-bc3814175a85 tempest-CinderUnicodeTest-1303163505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.eb599997-874a-42ce-bb80-7b90620220c3 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:53 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Volume volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f (f5cd19e9-f5ab-485a-b42f-ee406c5b376f): created successfully Apr 28 05:57:53 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7d2ac9-7945-4d0f-a38a-ffc8ee4dfd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:57:53 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Flow 'volume_create_manager' (6ca86aeb-d5db-406b-949a-acfb038e6529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:57:53 devstack sudo[90106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.eb599997-874a-42ce-bb80-7b90620220c3 Apr 28 05:57:53 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:53 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-08c373f9-3ccc-44f3-924c-ab44beb6f99c tempest-VolumesSnapshotTestJSON-56850989 None] Created volume successfully. Apr 28 05:57:54 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e5a35f24-332b-4b7a-947d-bc3814175a85 tempest-CinderUnicodeTest-1303163505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8.eb599997-874a-42ce-bb80-7b90620220c3" returned: 0 in 0.452s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e5a35f24-332b-4b7a-947d-bc3814175a85 tempest-CinderUnicodeTest-1303163505 None] Lock "cinder-quobyte-eb599997-874a-42ce-bb80-7b90620220c3" released by "_delete_snapshot" :: held 2.222s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e5a35f24-332b-4b7a-947d-bc3814175a85 tempest-CinderUnicodeTest-1303163505 None] Lock "cinder-quobyte-3f467dab-ceeb-436c-b69d-01e90c2a7de8" released by "delete_snapshot" :: held 2.247s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:54 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-e5a35f24-332b-4b7a-947d-bc3814175a85 tempest-CinderUnicodeTest-1303163505 None] Created reservations ['0f095290-e948-4305-94a7-83bd89a53d90', '023849ac-18be-4e5d-a57e-9f30605878e7', '4dccd9dd-70f6-4e49-b495-3e6abb8d4dda', '75b80eea-5c55-46cd-835e-0f354e55bcdf'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:57:54 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-e5a35f24-332b-4b7a-947d-bc3814175a85 tempest-CinderUnicodeTest-1303163505 None] Delete snapshot completed successfully. Apr 28 05:57:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e5a35f24-332b-4b7a-947d-bc3814175a85 tempest-CinderUnicodeTest-1303163505 None] Lock "cinder-eb599997-874a-42ce-bb80-7b90620220c3-delete_snapshot" released by "delete_snapshot" :: held 2.371s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a85161bf-8337-4d9b-9d59-ee9f6566df30 tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a85161bf-8337-4d9b-9d59-ee9f6566df30 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-a85161bf-8337-4d9b-9d59-ee9f6566df30 tempest-VolumesSnapshotTestJSON-56850989 None] Creating offline snapshot 16e9b74b-5ecc-406e-8e36-95e865ef8df0 of volume f5cd19e9-f5ab-485a-b42f-ee406c5b376f {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:57:54 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[f967d0e0-43d3-47c2-9aa2-7fc0169d8902]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a85161bf-8337-4d9b-9d59-ee9f6566df30 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:54 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f Apr 28 05:57:54 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7c7b0e4f-36cf-4cef-a9e9-7ce919877172 tempest-CinderUnicodeTest-1303163505 None] Acquiring lock "cinder-3f467dab-ceeb-436c-b69d-01e90c2a7de8-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7c7b0e4f-36cf-4cef-a9e9-7ce919877172 tempest-CinderUnicodeTest-1303163505 None] Lock "cinder-3f467dab-ceeb-436c-b69d-01e90c2a7de8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:55 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7c7b0e4f-36cf-4cef-a9e9-7ce919877172 tempest-CinderUnicodeTest-1303163505 None] Acquiring lock "cinder-quobyte-3f467dab-ceeb-436c-b69d-01e90c2a7de8" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:55 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7c7b0e4f-36cf-4cef-a9e9-7ce919877172 tempest-CinderUnicodeTest-1303163505 None] Lock "cinder-quobyte-3f467dab-ceeb-436c-b69d-01e90c2a7de8" acquired by "delete_volume" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:55 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[00683ff6-ceae-4dd2-9213-0b5385e8e0ce]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7c7b0e4f-36cf-4cef-a9e9-7ce919877172 tempest-CinderUnicodeTest-1303163505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:55 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8 Apr 28 05:57:55 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:55 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a85161bf-8337-4d9b-9d59-ee9f6566df30 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f" returned: 0 in 0.565s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a85161bf-8337-4d9b-9d59-ee9f6566df30 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.16e9b74b-5ecc-406e-8e36-95e865ef8df0 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:55 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.16e9b74b-5ecc-406e-8e36-95e865ef8df0 1G Apr 28 05:57:55 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:55 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7c7b0e4f-36cf-4cef-a9e9-7ce919877172 tempest-CinderUnicodeTest-1303163505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8" returned: 0 in 0.532s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7c7b0e4f-36cf-4cef-a9e9-7ce919877172 tempest-CinderUnicodeTest-1303163505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:55 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8 Apr 28 05:57:55 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:55 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a85161bf-8337-4d9b-9d59-ee9f6566df30 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.16e9b74b-5ecc-406e-8e36-95e865ef8df0 1G" returned: 0 in 0.585s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a85161bf-8337-4d9b-9d59-ee9f6566df30 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.16e9b74b-5ecc-406e-8e36-95e865ef8df0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:55 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.16e9b74b-5ecc-406e-8e36-95e865ef8df0 Apr 28 05:57:55 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:56 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7c7b0e4f-36cf-4cef-a9e9-7ce919877172 tempest-CinderUnicodeTest-1303163505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f467dab-ceeb-436c-b69d-01e90c2a7de8" returned: 0 in 0.474s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:56 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7c7b0e4f-36cf-4cef-a9e9-7ce919877172 tempest-CinderUnicodeTest-1303163505 None] Lock "cinder-quobyte-3f467dab-ceeb-436c-b69d-01e90c2a7de8" released by "delete_volume" :: held 1.065s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:56 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-7c7b0e4f-36cf-4cef-a9e9-7ce919877172 tempest-CinderUnicodeTest-1303163505 None] Created reservations ['444ab1cc-4968-4b8b-b405-c5d209e0db31', 'e3d74c65-a554-48fd-b2c4-beb3ac6e16d2', 'b5c0cf46-988b-42db-a8a5-8d2104051617', '3dd2df69-8a46-4a7f-9566-218a4e61ee09'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:57:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7c7b0e4f-36cf-4cef-a9e9-7ce919877172 tempest-CinderUnicodeTest-1303163505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7c7b0e4f-36cf-4cef-a9e9-7ce919877172 tempest-CinderUnicodeTest-1303163505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:56 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7c7b0e4f-36cf-4cef-a9e9-7ce919877172 tempest-CinderUnicodeTest-1303163505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:56 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7c7b0e4f-36cf-4cef-a9e9-7ce919877172 tempest-CinderUnicodeTest-1303163505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7c7b0e4f-36cf-4cef-a9e9-7ce919877172 tempest-CinderUnicodeTest-1303163505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7c7b0e4f-36cf-4cef-a9e9-7ce919877172 tempest-CinderUnicodeTest-1303163505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:56 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:57:56 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:56 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a85161bf-8337-4d9b-9d59-ee9f6566df30 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.16e9b74b-5ecc-406e-8e36-95e865ef8df0" returned: 0 in 0.497s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:56 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-a85161bf-8337-4d9b-9d59-ee9f6566df30 tempest-VolumesSnapshotTestJSON-56850989 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.16e9b74b-5ecc-406e-8e36-95e865ef8df0 is being set with open permissions: ugo+rw Apr 28 05:57:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a85161bf-8337-4d9b-9d59-ee9f6566df30 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.16e9b74b-5ecc-406e-8e36-95e865ef8df0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:56 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.16e9b74b-5ecc-406e-8e36-95e865ef8df0 Apr 28 05:57:56 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:56 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7c7b0e4f-36cf-4cef-a9e9-7ce919877172 tempest-CinderUnicodeTest-1303163505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.451s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:56 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-7c7b0e4f-36cf-4cef-a9e9-7ce919877172 tempest-CinderUnicodeTest-1303163505 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:57:56 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-7c7b0e4f-36cf-4cef-a9e9-7ce919877172 tempest-CinderUnicodeTest-1303163505 None] Deleted volume successfully. Apr 28 05:57:56 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7c7b0e4f-36cf-4cef-a9e9-7ce919877172 tempest-CinderUnicodeTest-1303163505 None] Lock "cinder-3f467dab-ceeb-436c-b69d-01e90c2a7de8-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:56 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a85161bf-8337-4d9b-9d59-ee9f6566df30 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.16e9b74b-5ecc-406e-8e36-95e865ef8df0" returned: 0 in 0.460s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a85161bf-8337-4d9b-9d59-ee9f6566df30 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:56 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.info Apr 28 05:57:56 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7c432966-69cb-4372-a1e2-401c034f74eb tempest-CinderUnicodeTest-1303163505 None] Acquiring lock "cinder-ccc0b9e7-ee11-43ea-b549-cbad6bc168f5-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7c432966-69cb-4372-a1e2-401c034f74eb tempest-CinderUnicodeTest-1303163505 None] Lock "cinder-ccc0b9e7-ee11-43ea-b549-cbad6bc168f5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7c432966-69cb-4372-a1e2-401c034f74eb tempest-CinderUnicodeTest-1303163505 None] Acquiring lock "cinder-quobyte-ccc0b9e7-ee11-43ea-b549-cbad6bc168f5" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7c432966-69cb-4372-a1e2-401c034f74eb tempest-CinderUnicodeTest-1303163505 None] Lock "cinder-quobyte-ccc0b9e7-ee11-43ea-b549-cbad6bc168f5" acquired by "delete_volume" :: waited 0.045s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:57 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a85161bf-8337-4d9b-9d59-ee9f6566df30 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.info" returned: 0 in 0.540s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:57 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-a85161bf-8337-4d9b-9d59-ee9f6566df30 tempest-VolumesSnapshotTestJSON-56850989 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.info is being set with open permissions: ugo+rw Apr 28 05:57:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a85161bf-8337-4d9b-9d59-ee9f6566df30 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:57 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e6d683-ed25-461a-9240-f733148ccfeb]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7c432966-69cb-4372-a1e2-401c034f74eb tempest-CinderUnicodeTest-1303163505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccc0b9e7-ee11-43ea-b549-cbad6bc168f5 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:57 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.info Apr 28 05:57:57 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:57 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccc0b9e7-ee11-43ea-b549-cbad6bc168f5 Apr 28 05:57:57 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:57 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a85161bf-8337-4d9b-9d59-ee9f6566df30 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.info" returned: 0 in 0.428s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a85161bf-8337-4d9b-9d59-ee9f6566df30 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.160s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:57 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-a85161bf-8337-4d9b-9d59-ee9f6566df30 tempest-VolumesSnapshotTestJSON-56850989 None] Create snapshot completed successfully Apr 28 05:57:57 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7c432966-69cb-4372-a1e2-401c034f74eb tempest-CinderUnicodeTest-1303163505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccc0b9e7-ee11-43ea-b549-cbad6bc168f5" returned: 0 in 0.568s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7c432966-69cb-4372-a1e2-401c034f74eb tempest-CinderUnicodeTest-1303163505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccc0b9e7-ee11-43ea-b549-cbad6bc168f5 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:57 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccc0b9e7-ee11-43ea-b549-cbad6bc168f5 Apr 28 05:57:57 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:58 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7c432966-69cb-4372-a1e2-401c034f74eb tempest-CinderUnicodeTest-1303163505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ccc0b9e7-ee11-43ea-b549-cbad6bc168f5" returned: 0 in 0.501s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7c432966-69cb-4372-a1e2-401c034f74eb tempest-CinderUnicodeTest-1303163505 None] Lock "cinder-quobyte-ccc0b9e7-ee11-43ea-b549-cbad6bc168f5" released by "delete_volume" :: held 1.131s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:58 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-7c432966-69cb-4372-a1e2-401c034f74eb tempest-CinderUnicodeTest-1303163505 None] Created reservations ['4eca41bc-8852-4c1f-9bc7-f02b73350f9f', '93201ba5-8cee-4289-9c3f-298efb1b7d0d', '8b737bbb-5c0e-4c3b-b8b2-8c3699310e90', 'b52bfc6c-c7de-49e4-b501-dae7f44f9702'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:57:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7c432966-69cb-4372-a1e2-401c034f74eb tempest-CinderUnicodeTest-1303163505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:57:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7c432966-69cb-4372-a1e2-401c034f74eb tempest-CinderUnicodeTest-1303163505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:57:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7c432966-69cb-4372-a1e2-401c034f74eb tempest-CinderUnicodeTest-1303163505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:57:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7c432966-69cb-4372-a1e2-401c034f74eb tempest-CinderUnicodeTest-1303163505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:57:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7c432966-69cb-4372-a1e2-401c034f74eb tempest-CinderUnicodeTest-1303163505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:57:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7c432966-69cb-4372-a1e2-401c034f74eb tempest-CinderUnicodeTest-1303163505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:58 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:57:58 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6ddba04c-edcb-4f84-9ca2-6e2086eee52d tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-16e9b74b-5ecc-406e-8e36-95e865ef8df0-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6ddba04c-edcb-4f84-9ca2-6e2086eee52d tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-16e9b74b-5ecc-406e-8e36-95e865ef8df0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6ddba04c-edcb-4f84-9ca2-6e2086eee52d tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-quobyte-f5cd19e9-f5ab-485a-b42f-ee406c5b376f" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:59 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7c432966-69cb-4372-a1e2-401c034f74eb tempest-CinderUnicodeTest-1303163505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.461s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:59 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-7c432966-69cb-4372-a1e2-401c034f74eb tempest-CinderUnicodeTest-1303163505 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:57:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6ddba04c-edcb-4f84-9ca2-6e2086eee52d tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-f5cd19e9-f5ab-485a-b42f-ee406c5b376f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6ddba04c-edcb-4f84-9ca2-6e2086eee52d tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-quobyte-16e9b74b-5ecc-406e-8e36-95e865ef8df0" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:57:59 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-7c432966-69cb-4372-a1e2-401c034f74eb tempest-CinderUnicodeTest-1303163505 None] Deleted volume successfully. Apr 28 05:57:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6ddba04c-edcb-4f84-9ca2-6e2086eee52d tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-16e9b74b-5ecc-406e-8e36-95e865ef8df0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:57:59 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-6ddba04c-edcb-4f84-9ca2-6e2086eee52d tempest-VolumesSnapshotTestJSON-56850989 None] Deleting offline snapshot 16e9b74b-5ecc-406e-8e36-95e865ef8df0 of volume f5cd19e9-f5ab-485a-b42f-ee406c5b376f {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:57:59 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-6ddba04c-edcb-4f84-9ca2-6e2086eee52d tempest-VolumesSnapshotTestJSON-56850989 None] snapshot_file for this snap is: volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.16e9b74b-5ecc-406e-8e36-95e865ef8df0 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:57:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7c432966-69cb-4372-a1e2-401c034f74eb tempest-CinderUnicodeTest-1303163505 None] Lock "cinder-ccc0b9e7-ee11-43ea-b549-cbad6bc168f5-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:57:59 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[94188c2e-0ebe-4a76-bae3-fb11d18ebcd2]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6ddba04c-edcb-4f84-9ca2-6e2086eee52d tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.16e9b74b-5ecc-406e-8e36-95e865ef8df0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:59 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.16e9b74b-5ecc-406e-8e36-95e865ef8df0 Apr 28 05:57:59 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:57:59 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Apr 28 05:57:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6ddba04c-edcb-4f84-9ca2-6e2086eee52d tempest-VolumesSnapshotTestJSON-56850989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.16e9b74b-5ecc-406e-8e36-95e865ef8df0" returned: 0 in 0.596s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:57:59 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-6ddba04c-edcb-4f84-9ca2-6e2086eee52d tempest-VolumesSnapshotTestJSON-56850989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:57:59 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad5df7d-4078-465d-b0e3-40ad0173151f]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:57:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6ddba04c-edcb-4f84-9ca2-6e2086eee52d tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:57:59 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f Apr 28 05:57:59 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:00 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6ddba04c-edcb-4f84-9ca2-6e2086eee52d tempest-VolumesSnapshotTestJSON-56850989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f" returned: 0 in 0.569s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6ddba04c-edcb-4f84-9ca2-6e2086eee52d tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.16e9b74b-5ecc-406e-8e36-95e865ef8df0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:00 devstack sudo[90167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.16e9b74b-5ecc-406e-8e36-95e865ef8df0 Apr 28 05:58:00 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:00 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6ddba04c-edcb-4f84-9ca2-6e2086eee52d tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.16e9b74b-5ecc-406e-8e36-95e865ef8df0" returned: 0 in 0.583s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6ddba04c-edcb-4f84-9ca2-6e2086eee52d tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.16e9b74b-5ecc-406e-8e36-95e865ef8df0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:00 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.16e9b74b-5ecc-406e-8e36-95e865ef8df0 Apr 28 05:58:00 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:01 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6ddba04c-edcb-4f84-9ca2-6e2086eee52d tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f.16e9b74b-5ecc-406e-8e36-95e865ef8df0" returned: 0 in 0.430s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6ddba04c-edcb-4f84-9ca2-6e2086eee52d tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-16e9b74b-5ecc-406e-8e36-95e865ef8df0" released by "_delete_snapshot" :: held 2.299s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6ddba04c-edcb-4f84-9ca2-6e2086eee52d tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-f5cd19e9-f5ab-485a-b42f-ee406c5b376f" released by "delete_snapshot" :: held 2.327s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:01 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-6ddba04c-edcb-4f84-9ca2-6e2086eee52d tempest-VolumesSnapshotTestJSON-56850989 None] Created reservations ['53f16d4f-ea36-4dee-8f9a-bdc6e765a330', 'e63e0725-8de5-4301-a341-5205dbee2d9b', 'b7749610-7fb4-47de-8162-2bfb08320255', '7a65b642-d535-4620-93f7-6679cba1ce86'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:58:01 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-6ddba04c-edcb-4f84-9ca2-6e2086eee52d tempest-VolumesSnapshotTestJSON-56850989 None] Delete snapshot completed successfully. Apr 28 05:58:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6ddba04c-edcb-4f84-9ca2-6e2086eee52d tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-16e9b74b-5ecc-406e-8e36-95e865ef8df0-delete_snapshot" released by "delete_snapshot" :: held 2.499s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:02 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:58:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Flow 'volume_create_manager' (bff0df87-e570-4f3b-b292-2567e268ac0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:58:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42405ad4-8e07-4375-bfbb-7833235c0a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42405ad4-8e07-4375-bfbb-7833235c0a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1960097932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c949e8-68c1-414d-bbc8-70cdb3725126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2d43cf5d6c4d3e96c2601c1c401fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:58:02Z,use_quota=True,user_id='8fee681d413e4c708123dcf5962a743b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c277ae-980a-47b6-80ba-d06de454e9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c277ae-980a-47b6-80ba-d06de454e9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2084108b-55a6-4581-997e-597e4b792b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2084108b-55a6-4581-997e-597e4b792b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4c949e8-68c1-414d-bbc8-70cdb3725126', 'volume_name': 'volume-f4c949e8-68c1-414d-bbc8-70cdb3725126', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f52086-33bb-4e9f-8848-67da949c00f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f52086-33bb-4e9f-8848-67da949c00f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e016f8a7-a698-40f8-9eeb-71aa180e368a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:02 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Volume f4c949e8-68c1-414d-bbc8-70cdb3725126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4c949e8-68c1-414d-bbc8-70cdb3725126', 'volume_size': 1} Apr 28 05:58:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:58:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:58:02 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1960097932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c949e8-68c1-414d-bbc8-70cdb3725126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2d43cf5d6c4d3e96c2601c1c401fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:58:02Z,use_quota=True,user_id='8fee681d413e4c708123dcf5962a743b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:58:02 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Creating volume f4c949e8-68c1-414d-bbc8-70cdb3725126 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:58:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:58:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:58:02 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:58:02 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:58:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:58:02 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:58:02 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:58:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:02 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 1073741824 Apr 28 05:58:02 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:03 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 1073741824" returned: 0 in 0.594s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:03 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 Apr 28 05:58:03 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:03 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126" returned: 0 in 0.456s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:03 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:58:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:58:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e016f8a7-a698-40f8-9eeb-71aa180e368a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c949e8-68c1-414d-bbc8-70cdb3725126', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99868be0-db5f-4070-93c3-32e8281b6cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:03 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Volume volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 (f4c949e8-68c1-414d-bbc8-70cdb3725126): created successfully Apr 28 05:58:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99868be0-db5f-4070-93c3-32e8281b6cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:03 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Flow 'volume_create_manager' (bff0df87-e570-4f3b-b292-2567e268ac0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:58:03 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-b734fc81-d58e-420f-81e7-892db6eb48ba tempest-VolumesSnapshotTestJSON-56850989 None] Created volume successfully. Apr 28 05:58:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f5e452bb-ac5f-483d-9a75-69cb67ce5ed8 tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:58:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f5e452bb-ac5f-483d-9a75-69cb67ce5ed8 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:58:04 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-f5e452bb-ac5f-483d-9a75-69cb67ce5ed8 tempest-VolumesSnapshotTestJSON-56850989 None] Creating offline snapshot 1813ab92-4480-4775-a5b9-33997e7336d1 of volume f4c949e8-68c1-414d-bbc8-70cdb3725126 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:58:04 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[381596f9-6918-4b8a-aa03-0752024226b1]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:58:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f5e452bb-ac5f-483d-9a75-69cb67ce5ed8 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:04 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 Apr 28 05:58:04 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:05 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f5e452bb-ac5f-483d-9a75-69cb67ce5ed8 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126" returned: 0 in 0.512s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f5e452bb-ac5f-483d-9a75-69cb67ce5ed8 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:05 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1 1G Apr 28 05:58:05 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:05 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f5e452bb-ac5f-483d-9a75-69cb67ce5ed8 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1 1G" returned: 0 in 0.601s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f5e452bb-ac5f-483d-9a75-69cb67ce5ed8 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:05 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1 Apr 28 05:58:05 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:06 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f5e452bb-ac5f-483d-9a75-69cb67ce5ed8 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1" returned: 0 in 0.485s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:06 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-f5e452bb-ac5f-483d-9a75-69cb67ce5ed8 tempest-VolumesSnapshotTestJSON-56850989 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1 is being set with open permissions: ugo+rw Apr 28 05:58:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f5e452bb-ac5f-483d-9a75-69cb67ce5ed8 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:06 devstack sudo[90199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1 Apr 28 05:58:06 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:06 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f5e452bb-ac5f-483d-9a75-69cb67ce5ed8 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1" returned: 0 in 0.423s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f5e452bb-ac5f-483d-9a75-69cb67ce5ed8 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:06 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.info Apr 28 05:58:06 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:06 devstack cinder-volume[81829]: DEBUG oslo_service.periodic_task [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81829) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 05:58:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:58:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:58:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:58:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:58:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:58:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:06 devstack sudo[90204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:58:06 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:07 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f5e452bb-ac5f-483d-9a75-69cb67ce5ed8 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.info" returned: 0 in 0.431s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:07 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-f5e452bb-ac5f-483d-9a75-69cb67ce5ed8 tempest-VolumesSnapshotTestJSON-56850989 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.info is being set with open permissions: ugo+rw Apr 28 05:58:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f5e452bb-ac5f-483d-9a75-69cb67ce5ed8 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:07 devstack sudo[90207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.info Apr 28 05:58:07 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:07 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.453s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:07 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:58:07 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f5e452bb-ac5f-483d-9a75-69cb67ce5ed8 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.info" returned: 0 in 0.459s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f5e452bb-ac5f-483d-9a75-69cb67ce5ed8 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.995s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:58:07 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-f5e452bb-ac5f-483d-9a75-69cb67ce5ed8 tempest-VolumesSnapshotTestJSON-56850989 None] Create snapshot completed successfully Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Flow 'volume_create_manager' (438f8fdd-cb9b-4242-9aae-36891627870b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8941ddd-522a-4263-869c-72adc1af4b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8941ddd-522a-4263-869c-72adc1af4b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-519963640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c178e89-e6d2-49ab-af29-cec81cb0bffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2d43cf5d6c4d3e96c2601c1c401fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:58:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1813ab92-4480-4775-a5b9-33997e7336d1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:58:08Z,use_quota=True,user_id='8fee681d413e4c708123dcf5962a743b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75a22c3-100f-4fca-bd8a-24444c9bf4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75a22c3-100f-4fca-bd8a-24444c9bf4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9030f5-16c8-4464-af6c-0b2d56d334b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9030f5-16c8-4464-af6c-0b2d56d334b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3c178e89-e6d2-49ab-af29-cec81cb0bffd', 'volume_name': 'volume-3c178e89-e6d2-49ab-af29-cec81cb0bffd', 'volume_size': 2, 'snapshot_id': '1813ab92-4480-4775-a5b9-33997e7336d1'}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58f45f1-f8b6-4232-aeb5-33fc77210e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58f45f1-f8b6-4232-aeb5-33fc77210e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac32c59-4129-43e6-a462-a9b7cb136a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:08 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Volume 3c178e89-e6d2-49ab-af29-cec81cb0bffd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3c178e89-e6d2-49ab-af29-cec81cb0bffd', 'volume_size': 2, 'snapshot_id': '1813ab92-4480-4775-a5b9-33997e7336d1'} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-quobyte-1813ab92-4480-4775-a5b9-33997e7336d1-3c178e89-e6d2-49ab-af29-cec81cb0bffd" by "_create_volume_from_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-1813ab92-4480-4775-a5b9-33997e7336d1-3c178e89-e6d2-49ab-af29-cec81cb0bffd" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Creating volume 3c178e89-e6d2-49ab-af29-cec81cb0bffd from snapshot 1813ab92-4480-4775-a5b9-33997e7336d1 {{(pid=81829) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-quobyte-3c178e89-e6d2-49ab-af29-cec81cb0bffd" by "_copy_volume_from_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-3c178e89-e6d2-49ab-af29-cec81cb0bffd" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] snapshot: 1813ab92-4480-4775-a5b9-33997e7336d1, volume: 3c178e89-e6d2-49ab-af29-cec81cb0bffd, {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[050e475c-f9f5-41dc-bed6-5b9ddd527119]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:08 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1 Apr 28 05:58:08 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:08 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1" returned: 0 in 0.497s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4c949e8-68c1-414d-bbc8-70cdb3725126(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] will copy from snapshot at /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Creating direct copy from snapshot {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[360f76a0-d0d0-4f42-a260-a61280c87c8b]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:58:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:09 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 Apr 28 05:58:09 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:09 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126" returned: 0 in 0.513s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:09 devstack cinder-volume[81829]: DEBUG cinder.utils [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Path /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3c178e89-e6d2-49ab-af29-cec81cb0bffd not found in is_blk_device check {{(pid=81829) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 05:58:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3c178e89-e6d2-49ab-af29-cec81cb0bffd {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:09 devstack sudo[90223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3c178e89-e6d2-49ab-af29-cec81cb0bffd Apr 28 05:58:09 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:14 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3c178e89-e6d2-49ab-af29-cec81cb0bffd" returned: 0 in 4.543s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:14 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[41418cb8-d436-40a8-a3e0-bc321b8232ed]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:58:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:14 devstack sudo[90236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 Apr 28 05:58:14 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:14 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126" returned: 0 in 0.648s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:14 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Image conversion details: src /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126, size 1024.00 MB, duration 4.54 sec, destination /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3c178e89-e6d2-49ab-af29-cec81cb0bffd {{(pid=81829) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:58:14 devstack cinder-volume[81829]: INFO cinder.image.image_utils [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Converted 1024.00 MB image at 225.31 MB/s Apr 28 05:58:14 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3c178e89-e6d2-49ab-af29-cec81cb0bffd is being set with open permissions: ugo+rw Apr 28 05:58:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3c178e89-e6d2-49ab-af29-cec81cb0bffd {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:14 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3c178e89-e6d2-49ab-af29-cec81cb0bffd Apr 28 05:58:14 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:15 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3c178e89-e6d2-49ab-af29-cec81cb0bffd" returned: 0 in 0.442s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-3c178e89-e6d2-49ab-af29-cec81cb0bffd" released by "_copy_volume_from_snapshot" :: held 6.735s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-1813ab92-4480-4775-a5b9-33997e7336d1-3c178e89-e6d2-49ab-af29-cec81cb0bffd" released by "_create_volume_from_snapshot" :: held 6.766s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.794s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:58:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac32c59-4129-43e6-a462-a9b7cb136a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c178e89-e6d2-49ab-af29-cec81cb0bffd', 'volume_size': 2, 'snapshot_id': '1813ab92-4480-4775-a5b9-33997e7336d1'}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4511c451-928e-470b-8c7f-6446d69c1c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:15 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Volume volume-3c178e89-e6d2-49ab-af29-cec81cb0bffd (3c178e89-e6d2-49ab-af29-cec81cb0bffd): created successfully Apr 28 05:58:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4511c451-928e-470b-8c7f-6446d69c1c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Flow 'volume_create_manager' (438f8fdd-cb9b-4242-9aae-36891627870b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:58:15 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-60674dad-64bf-407c-b710-26330e1b238a tempest-VolumesSnapshotTestJSON-56850989 None] Created volume successfully. Apr 28 05:58:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0cb2be50-e58e-4468-9cbf-1efe963af394 tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-3c178e89-e6d2-49ab-af29-cec81cb0bffd-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:58:16 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0cb2be50-e58e-4468-9cbf-1efe963af394 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-3c178e89-e6d2-49ab-af29-cec81cb0bffd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:58:16 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0cb2be50-e58e-4468-9cbf-1efe963af394 tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-quobyte-3c178e89-e6d2-49ab-af29-cec81cb0bffd" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:58:16 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0cb2be50-e58e-4468-9cbf-1efe963af394 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-3c178e89-e6d2-49ab-af29-cec81cb0bffd" acquired by "delete_volume" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:58:16 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bc0772-0b4b-498d-89f6-ebaf65c73bdd]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:58:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0cb2be50-e58e-4468-9cbf-1efe963af394 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3c178e89-e6d2-49ab-af29-cec81cb0bffd {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:16 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3c178e89-e6d2-49ab-af29-cec81cb0bffd Apr 28 05:58:16 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:16 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0cb2be50-e58e-4468-9cbf-1efe963af394 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3c178e89-e6d2-49ab-af29-cec81cb0bffd" returned: 0 in 0.524s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0cb2be50-e58e-4468-9cbf-1efe963af394 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3c178e89-e6d2-49ab-af29-cec81cb0bffd {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:16 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3c178e89-e6d2-49ab-af29-cec81cb0bffd Apr 28 05:58:16 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:17 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0cb2be50-e58e-4468-9cbf-1efe963af394 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3c178e89-e6d2-49ab-af29-cec81cb0bffd" returned: 0 in 0.439s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:17 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0cb2be50-e58e-4468-9cbf-1efe963af394 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-3c178e89-e6d2-49ab-af29-cec81cb0bffd" released by "delete_volume" :: held 1.006s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:17 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-0cb2be50-e58e-4468-9cbf-1efe963af394 tempest-VolumesSnapshotTestJSON-56850989 None] Created reservations ['041ae308-e267-4bfe-a1b4-bc5bfa6519a3', 'c7ef1b48-0103-4a99-9eca-7348aa6bc35f', '032222a8-0b94-4cd4-9bbb-2a7a775d8dc0', '8e725e8f-8e2c-49dc-8e67-9b79e5d7198e'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:58:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0cb2be50-e58e-4468-9cbf-1efe963af394 tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:58:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0cb2be50-e58e-4468-9cbf-1efe963af394 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:58:17 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-0cb2be50-e58e-4468-9cbf-1efe963af394 tempest-VolumesSnapshotTestJSON-56850989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:58:17 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-0cb2be50-e58e-4468-9cbf-1efe963af394 tempest-VolumesSnapshotTestJSON-56850989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:58:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0cb2be50-e58e-4468-9cbf-1efe963af394 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:58:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0cb2be50-e58e-4468-9cbf-1efe963af394 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:17 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:58:17 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:17 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0cb2be50-e58e-4468-9cbf-1efe963af394 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.430s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:17 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-0cb2be50-e58e-4468-9cbf-1efe963af394 tempest-VolumesSnapshotTestJSON-56850989 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:58:17 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-0cb2be50-e58e-4468-9cbf-1efe963af394 tempest-VolumesSnapshotTestJSON-56850989 None] Deleted volume successfully. Apr 28 05:58:17 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0cb2be50-e58e-4468-9cbf-1efe963af394 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-3c178e89-e6d2-49ab-af29-cec81cb0bffd-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:18 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-04d61595-bb96-4e0a-8408-9d0c97c865be tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-1813ab92-4480-4775-a5b9-33997e7336d1-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:58:18 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-04d61595-bb96-4e0a-8408-9d0c97c865be tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-1813ab92-4480-4775-a5b9-33997e7336d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:58:18 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-04d61595-bb96-4e0a-8408-9d0c97c865be tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-quobyte-f4c949e8-68c1-414d-bbc8-70cdb3725126" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:58:18 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-04d61595-bb96-4e0a-8408-9d0c97c865be tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-f4c949e8-68c1-414d-bbc8-70cdb3725126" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:58:18 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-04d61595-bb96-4e0a-8408-9d0c97c865be tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-quobyte-1813ab92-4480-4775-a5b9-33997e7336d1" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:58:18 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-04d61595-bb96-4e0a-8408-9d0c97c865be tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-1813ab92-4480-4775-a5b9-33997e7336d1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:58:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-04d61595-bb96-4e0a-8408-9d0c97c865be tempest-VolumesSnapshotTestJSON-56850989 None] Deleting offline snapshot 1813ab92-4480-4775-a5b9-33997e7336d1 of volume f4c949e8-68c1-414d-bbc8-70cdb3725126 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:58:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-04d61595-bb96-4e0a-8408-9d0c97c865be tempest-VolumesSnapshotTestJSON-56850989 None] snapshot_file for this snap is: volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:58:18 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2d104d-f499-4af0-b68b-4f0cb1481f08]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:58:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-04d61595-bb96-4e0a-8408-9d0c97c865be tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:18 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1 Apr 28 05:58:18 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:18 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-04d61595-bb96-4e0a-8408-9d0c97c865be tempest-VolumesSnapshotTestJSON-56850989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1" returned: 0 in 0.512s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-04d61595-bb96-4e0a-8408-9d0c97c865be tempest-VolumesSnapshotTestJSON-56850989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4c949e8-68c1-414d-bbc8-70cdb3725126(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:58:18 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47ef1a6-b22f-405f-b3da-f3cc93334521]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:58:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-04d61595-bb96-4e0a-8408-9d0c97c865be tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:18 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 Apr 28 05:58:18 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:19 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-04d61595-bb96-4e0a-8408-9d0c97c865be tempest-VolumesSnapshotTestJSON-56850989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126" returned: 0 in 0.544s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-04d61595-bb96-4e0a-8408-9d0c97c865be tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:19 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1 Apr 28 05:58:19 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:19 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-04d61595-bb96-4e0a-8408-9d0c97c865be tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1" returned: 0 in 0.522s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-04d61595-bb96-4e0a-8408-9d0c97c865be tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:19 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1 Apr 28 05:58:19 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:20 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-04d61595-bb96-4e0a-8408-9d0c97c865be tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126.1813ab92-4480-4775-a5b9-33997e7336d1" returned: 0 in 0.470s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-04d61595-bb96-4e0a-8408-9d0c97c865be tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-1813ab92-4480-4775-a5b9-33997e7336d1" released by "_delete_snapshot" :: held 2.148s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-04d61595-bb96-4e0a-8408-9d0c97c865be tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-f4c949e8-68c1-414d-bbc8-70cdb3725126" released by "delete_snapshot" :: held 2.170s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:20 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-04d61595-bb96-4e0a-8408-9d0c97c865be tempest-VolumesSnapshotTestJSON-56850989 None] Created reservations ['6fe77a4a-4ecd-4d07-82d4-3bc7aa8e043f', 'afef64f4-aa8a-48ab-8728-f39406719a92', '74c8e5d4-e1d0-425f-bada-76dc8828c230', '1b9c3814-87f8-4eca-8209-b029ef1f31c8'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:58:20 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-04d61595-bb96-4e0a-8408-9d0c97c865be tempest-VolumesSnapshotTestJSON-56850989 None] Delete snapshot completed successfully. Apr 28 05:58:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-04d61595-bb96-4e0a-8408-9d0c97c865be tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-1813ab92-4480-4775-a5b9-33997e7336d1-delete_snapshot" released by "delete_snapshot" :: held 2.293s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0b6726ba-ed26-473f-8f72-e4dab8d76006 tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-f4c949e8-68c1-414d-bbc8-70cdb3725126-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:58:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0b6726ba-ed26-473f-8f72-e4dab8d76006 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-f4c949e8-68c1-414d-bbc8-70cdb3725126-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:58:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0b6726ba-ed26-473f-8f72-e4dab8d76006 tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-quobyte-f4c949e8-68c1-414d-bbc8-70cdb3725126" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:58:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0b6726ba-ed26-473f-8f72-e4dab8d76006 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-f4c949e8-68c1-414d-bbc8-70cdb3725126" acquired by "delete_volume" :: waited 0.014s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:58:21 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4ef761-1377-445a-be67-3a179b2b9997]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:58:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b6726ba-ed26-473f-8f72-e4dab8d76006 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:21 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 Apr 28 05:58:21 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:22 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b6726ba-ed26-473f-8f72-e4dab8d76006 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126" returned: 0 in 0.528s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b6726ba-ed26-473f-8f72-e4dab8d76006 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:22 devstack sudo[90313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126 Apr 28 05:58:22 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:22 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b6726ba-ed26-473f-8f72-e4dab8d76006 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f4c949e8-68c1-414d-bbc8-70cdb3725126" returned: 0 in 0.485s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:22 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0b6726ba-ed26-473f-8f72-e4dab8d76006 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-f4c949e8-68c1-414d-bbc8-70cdb3725126" released by "delete_volume" :: held 1.071s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:22 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-0b6726ba-ed26-473f-8f72-e4dab8d76006 tempest-VolumesSnapshotTestJSON-56850989 None] Created reservations ['8f313b69-efb7-4bb7-8723-8e5ca10266a6', 'd9751dc0-4383-4dcb-94cf-64c3729c89e9', '07ac057b-f92c-4053-a4e4-30e4902491d4', '883ad77a-14b7-4726-9a2e-2e5d1e3698ce'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:58:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0b6726ba-ed26-473f-8f72-e4dab8d76006 tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:58:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0b6726ba-ed26-473f-8f72-e4dab8d76006 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:58:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-0b6726ba-ed26-473f-8f72-e4dab8d76006 tempest-VolumesSnapshotTestJSON-56850989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:58:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-0b6726ba-ed26-473f-8f72-e4dab8d76006 tempest-VolumesSnapshotTestJSON-56850989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:58:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0b6726ba-ed26-473f-8f72-e4dab8d76006 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:58:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b6726ba-ed26-473f-8f72-e4dab8d76006 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:22 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:58:22 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:23 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b6726ba-ed26-473f-8f72-e4dab8d76006 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.467s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:23 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-0b6726ba-ed26-473f-8f72-e4dab8d76006 tempest-VolumesSnapshotTestJSON-56850989 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:58:23 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-0b6726ba-ed26-473f-8f72-e4dab8d76006 tempest-VolumesSnapshotTestJSON-56850989 None] Deleted volume successfully. Apr 28 05:58:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0b6726ba-ed26-473f-8f72-e4dab8d76006 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-f4c949e8-68c1-414d-bbc8-70cdb3725126-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Flow 'volume_create_manager' (1c59015c-bcf2-4298-9a86-1e55946de768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8db4891-fceb-4926-b12c-682e4384d0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8db4891-fceb-4926-b12c-682e4384d0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1945703250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a4f4bb-6974-4a37-a924-3867ec00ba8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2d43cf5d6c4d3e96c2601c1c401fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:58:24Z,use_quota=True,user_id='8fee681d413e4c708123dcf5962a743b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbe344c-dc30-4e97-be1e-24138c6679ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbe344c-dc30-4e97-be1e-24138c6679ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2416bd-f25c-4e9a-acb2-c081c3802fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2416bd-f25c-4e9a-acb2-c081c3802fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71a4f4bb-6974-4a37-a924-3867ec00ba8d', 'volume_name': 'volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (633af4e3-4943-46c7-8fff-b098a0672ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (633af4e3-4943-46c7-8fff-b098a0672ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1521fa62-ac55-482b-aaba-94f8a5766456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:24 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Volume 71a4f4bb-6974-4a37-a924-3867ec00ba8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d', 'volume_size': 1} Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1945703250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a4f4bb-6974-4a37-a924-3867ec00ba8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2d43cf5d6c4d3e96c2601c1c401fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:58:24Z,use_quota=True,user_id='8fee681d413e4c708123dcf5962a743b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Creating volume 71a4f4bb-6974-4a37-a924-3867ec00ba8d {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:58:24 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:24 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d 1073741824 Apr 28 05:58:24 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:24 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d 1073741824" returned: 0 in 0.601s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:24 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d Apr 28 05:58:24 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:25 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d" returned: 0 in 0.447s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:58:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:58:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1521fa62-ac55-482b-aaba-94f8a5766456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e919bf-4d47-4263-97b0-9d326e3bb494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:25 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Volume volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d (71a4f4bb-6974-4a37-a924-3867ec00ba8d): created successfully Apr 28 05:58:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e919bf-4d47-4263-97b0-9d326e3bb494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Flow 'volume_create_manager' (1c59015c-bcf2-4298-9a86-1e55946de768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:58:25 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-85c22678-b444-400a-9dae-efc79a6ea223 tempest-VolumesSnapshotTestJSON-56850989 None] Created volume successfully. Apr 28 05:58:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dfd9f6bb-de92-409f-89a1-38f08b7efcbd tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:58:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dfd9f6bb-de92-409f-89a1-38f08b7efcbd tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:58:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-dfd9f6bb-de92-409f-89a1-38f08b7efcbd tempest-VolumesSnapshotTestJSON-56850989 None] Creating offline snapshot 9b04c377-f996-4071-9a5b-7c2b3321a9e0 of volume 71a4f4bb-6974-4a37-a924-3867ec00ba8d {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:58:26 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a415948-f59c-41c9-a7ae-5f604d1030ca]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:58:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dfd9f6bb-de92-409f-89a1-38f08b7efcbd tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:26 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d Apr 28 05:58:26 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:26 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dfd9f6bb-de92-409f-89a1-38f08b7efcbd tempest-VolumesSnapshotTestJSON-56850989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d" returned: 0 in 0.502s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dfd9f6bb-de92-409f-89a1-38f08b7efcbd tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:26 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0 1G Apr 28 05:58:26 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:27 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dfd9f6bb-de92-409f-89a1-38f08b7efcbd tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0 1G" returned: 0 in 0.607s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dfd9f6bb-de92-409f-89a1-38f08b7efcbd tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:27 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0 Apr 28 05:58:27 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:27 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dfd9f6bb-de92-409f-89a1-38f08b7efcbd tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0" returned: 0 in 0.473s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:27 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-dfd9f6bb-de92-409f-89a1-38f08b7efcbd tempest-VolumesSnapshotTestJSON-56850989 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0 is being set with open permissions: ugo+rw Apr 28 05:58:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dfd9f6bb-de92-409f-89a1-38f08b7efcbd tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:27 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0 Apr 28 05:58:27 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:28 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dfd9f6bb-de92-409f-89a1-38f08b7efcbd tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0" returned: 0 in 0.441s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dfd9f6bb-de92-409f-89a1-38f08b7efcbd tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:28 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.info Apr 28 05:58:28 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:28 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dfd9f6bb-de92-409f-89a1-38f08b7efcbd tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.info" returned: 0 in 0.424s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:28 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-dfd9f6bb-de92-409f-89a1-38f08b7efcbd tempest-VolumesSnapshotTestJSON-56850989 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.info is being set with open permissions: ugo+rw Apr 28 05:58:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dfd9f6bb-de92-409f-89a1-38f08b7efcbd tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:28 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.info Apr 28 05:58:28 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:29 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dfd9f6bb-de92-409f-89a1-38f08b7efcbd tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.info" returned: 0 in 0.442s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dfd9f6bb-de92-409f-89a1-38f08b7efcbd tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.971s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:58:29 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-dfd9f6bb-de92-409f-89a1-38f08b7efcbd tempest-VolumesSnapshotTestJSON-56850989 None] Create snapshot completed successfully Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Flow 'volume_create_manager' (5176c074-a62a-4d1c-825a-b8ff42998301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd08869c-abd5-4828-86e5-187cb75f72b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd08869c-abd5-4828-86e5-187cb75f72b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1210251731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f02df3f-0110-41bb-a5f3-ae958b0caae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2d43cf5d6c4d3e96c2601c1c401fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9b04c377-f996-4071-9a5b-7c2b3321a9e0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:58:30Z,use_quota=True,user_id='8fee681d413e4c708123dcf5962a743b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f4fc46-ab5a-4a29-bb4e-32487687d4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f4fc46-ab5a-4a29-bb4e-32487687d4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e10f22c-5286-4222-8a3f-fe166a9b0afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e10f22c-5286-4222-8a3f-fe166a9b0afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4f02df3f-0110-41bb-a5f3-ae958b0caae4', 'volume_name': 'volume-4f02df3f-0110-41bb-a5f3-ae958b0caae4', 'volume_size': 1, 'snapshot_id': '9b04c377-f996-4071-9a5b-7c2b3321a9e0'}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716c7698-fad5-4da9-b4ed-2cf8b96b1aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716c7698-fad5-4da9-b4ed-2cf8b96b1aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a921214-3887-40c4-995f-e98dd575d928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:29 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Volume 4f02df3f-0110-41bb-a5f3-ae958b0caae4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4f02df3f-0110-41bb-a5f3-ae958b0caae4', 'volume_size': 1, 'snapshot_id': '9b04c377-f996-4071-9a5b-7c2b3321a9e0'} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-quobyte-9b04c377-f996-4071-9a5b-7c2b3321a9e0-4f02df3f-0110-41bb-a5f3-ae958b0caae4" by "_create_volume_from_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-9b04c377-f996-4071-9a5b-7c2b3321a9e0-4f02df3f-0110-41bb-a5f3-ae958b0caae4" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Creating volume 4f02df3f-0110-41bb-a5f3-ae958b0caae4 from snapshot 9b04c377-f996-4071-9a5b-7c2b3321a9e0 {{(pid=81829) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-quobyte-4f02df3f-0110-41bb-a5f3-ae958b0caae4" by "_copy_volume_from_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-4f02df3f-0110-41bb-a5f3-ae958b0caae4" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] snapshot: 9b04c377-f996-4071-9a5b-7c2b3321a9e0, volume: 4f02df3f-0110-41bb-a5f3-ae958b0caae4, {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e8003c-5d12-440b-8e70-4442682329d6]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:58:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:30 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0 Apr 28 05:58:30 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:30 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0" returned: 0 in 0.530s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:58:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] will copy from snapshot at /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 05:58:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Creating direct copy from snapshot {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 05:58:30 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5a4b2e-39e2-45fc-abad-177d2fa2b931]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:58:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:30 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d Apr 28 05:58:30 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:31 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d" returned: 0 in 0.527s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:31 devstack cinder-volume[81829]: DEBUG cinder.utils [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Path /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4f02df3f-0110-41bb-a5f3-ae958b0caae4 not found in is_blk_device check {{(pid=81829) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 05:58:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4f02df3f-0110-41bb-a5f3-ae958b0caae4 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:31 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4f02df3f-0110-41bb-a5f3-ae958b0caae4 Apr 28 05:58:31 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:35 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4f02df3f-0110-41bb-a5f3-ae958b0caae4" returned: 0 in 4.551s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:35 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[a397cd5f-17da-422a-9a45-b84d53b0c209]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:58:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:35 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d Apr 28 05:58:35 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:36 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d" returned: 0 in 0.646s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:36 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Image conversion details: src /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d, size 1024.00 MB, duration 4.55 sec, destination /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4f02df3f-0110-41bb-a5f3-ae958b0caae4 {{(pid=81829) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:58:36 devstack cinder-volume[81829]: INFO cinder.image.image_utils [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Converted 1024.00 MB image at 224.93 MB/s Apr 28 05:58:36 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4f02df3f-0110-41bb-a5f3-ae958b0caae4 is being set with open permissions: ugo+rw Apr 28 05:58:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4f02df3f-0110-41bb-a5f3-ae958b0caae4 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:36 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4f02df3f-0110-41bb-a5f3-ae958b0caae4 Apr 28 05:58:36 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:36 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4f02df3f-0110-41bb-a5f3-ae958b0caae4" returned: 0 in 0.413s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-4f02df3f-0110-41bb-a5f3-ae958b0caae4" released by "_copy_volume_from_snapshot" :: held 6.756s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-9b04c377-f996-4071-9a5b-7c2b3321a9e0-4f02df3f-0110-41bb-a5f3-ae958b0caae4" released by "_create_volume_from_snapshot" :: held 6.793s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.811s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:58:36 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a921214-3887-40c4-995f-e98dd575d928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f02df3f-0110-41bb-a5f3-ae958b0caae4', 'volume_size': 1, 'snapshot_id': '9b04c377-f996-4071-9a5b-7c2b3321a9e0'}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:36 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a1bc0e-26bd-450d-a77a-8300b0a34a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:36 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Volume volume-4f02df3f-0110-41bb-a5f3-ae958b0caae4 (4f02df3f-0110-41bb-a5f3-ae958b0caae4): created successfully Apr 28 05:58:36 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a1bc0e-26bd-450d-a77a-8300b0a34a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:36 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Flow 'volume_create_manager' (5176c074-a62a-4d1c-825a-b8ff42998301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:58:36 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-47be30c9-7a94-4eb5-8a69-d6c7fcdf6dec tempest-VolumesSnapshotTestJSON-56850989 None] Created volume successfully. Apr 28 05:58:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9ed21c8e-b211-4bf5-9648-9181f403ebff tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-4f02df3f-0110-41bb-a5f3-ae958b0caae4-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:58:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9ed21c8e-b211-4bf5-9648-9181f403ebff tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-4f02df3f-0110-41bb-a5f3-ae958b0caae4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:58:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9ed21c8e-b211-4bf5-9648-9181f403ebff tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-quobyte-4f02df3f-0110-41bb-a5f3-ae958b0caae4" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:58:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9ed21c8e-b211-4bf5-9648-9181f403ebff tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-4f02df3f-0110-41bb-a5f3-ae958b0caae4" acquired by "delete_volume" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:58:37 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8e1a3c-5717-475a-8484-72b61a187299]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:58:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9ed21c8e-b211-4bf5-9648-9181f403ebff tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4f02df3f-0110-41bb-a5f3-ae958b0caae4 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:37 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4f02df3f-0110-41bb-a5f3-ae958b0caae4 Apr 28 05:58:37 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:37 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9ed21c8e-b211-4bf5-9648-9181f403ebff tempest-VolumesSnapshotTestJSON-56850989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4f02df3f-0110-41bb-a5f3-ae958b0caae4" returned: 0 in 0.504s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9ed21c8e-b211-4bf5-9648-9181f403ebff tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4f02df3f-0110-41bb-a5f3-ae958b0caae4 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:37 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4f02df3f-0110-41bb-a5f3-ae958b0caae4 Apr 28 05:58:37 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:38 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9ed21c8e-b211-4bf5-9648-9181f403ebff tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4f02df3f-0110-41bb-a5f3-ae958b0caae4" returned: 0 in 0.455s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:38 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9ed21c8e-b211-4bf5-9648-9181f403ebff tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-4f02df3f-0110-41bb-a5f3-ae958b0caae4" released by "delete_volume" :: held 1.010s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:38 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:SELECT=91,cinder:INSERT=34,cinder:UPDATE=111,cinder:DELETE=12 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:58:38 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-9ed21c8e-b211-4bf5-9648-9181f403ebff tempest-VolumesSnapshotTestJSON-56850989 None] Created reservations ['5df2e63d-0559-40ed-a920-4860c2fa967d', '8b8b0eeb-781e-4629-aad9-63fa38d5042b', 'd35a82b0-bee3-4cac-b0b4-ef286b529c54', '53a85576-332c-4858-8045-d955c8551bb2'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:58:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9ed21c8e-b211-4bf5-9648-9181f403ebff tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:58:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9ed21c8e-b211-4bf5-9648-9181f403ebff tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:58:38 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-9ed21c8e-b211-4bf5-9648-9181f403ebff tempest-VolumesSnapshotTestJSON-56850989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:58:38 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-9ed21c8e-b211-4bf5-9648-9181f403ebff tempest-VolumesSnapshotTestJSON-56850989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:58:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9ed21c8e-b211-4bf5-9648-9181f403ebff tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:58:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9ed21c8e-b211-4bf5-9648-9181f403ebff tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:38 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:58:38 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:38 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9ed21c8e-b211-4bf5-9648-9181f403ebff tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.436s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:38 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-9ed21c8e-b211-4bf5-9648-9181f403ebff tempest-VolumesSnapshotTestJSON-56850989 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:58:38 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-9ed21c8e-b211-4bf5-9648-9181f403ebff tempest-VolumesSnapshotTestJSON-56850989 None] Deleted volume successfully. Apr 28 05:58:38 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-9ed21c8e-b211-4bf5-9648-9181f403ebff tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-4f02df3f-0110-41bb-a5f3-ae958b0caae4-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:39 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-00eb8f12-eb9d-4313-a971-e412eaad7660 tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-9b04c377-f996-4071-9a5b-7c2b3321a9e0-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:58:39 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-00eb8f12-eb9d-4313-a971-e412eaad7660 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-9b04c377-f996-4071-9a5b-7c2b3321a9e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:58:39 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-00eb8f12-eb9d-4313-a971-e412eaad7660 tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-quobyte-71a4f4bb-6974-4a37-a924-3867ec00ba8d" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:58:39 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-00eb8f12-eb9d-4313-a971-e412eaad7660 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-71a4f4bb-6974-4a37-a924-3867ec00ba8d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:58:39 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-00eb8f12-eb9d-4313-a971-e412eaad7660 tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-quobyte-9b04c377-f996-4071-9a5b-7c2b3321a9e0" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:58:39 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-00eb8f12-eb9d-4313-a971-e412eaad7660 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-9b04c377-f996-4071-9a5b-7c2b3321a9e0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:58:39 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-00eb8f12-eb9d-4313-a971-e412eaad7660 tempest-VolumesSnapshotTestJSON-56850989 None] Deleting offline snapshot 9b04c377-f996-4071-9a5b-7c2b3321a9e0 of volume 71a4f4bb-6974-4a37-a924-3867ec00ba8d {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:58:39 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-00eb8f12-eb9d-4313-a971-e412eaad7660 tempest-VolumesSnapshotTestJSON-56850989 None] snapshot_file for this snap is: volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:58:39 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[b580a233-7e2e-427b-8751-950310791fef]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:58:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-00eb8f12-eb9d-4313-a971-e412eaad7660 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:39 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0 Apr 28 05:58:39 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:40 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-00eb8f12-eb9d-4313-a971-e412eaad7660 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0" returned: 0 in 0.517s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-00eb8f12-eb9d-4313-a971-e412eaad7660 tempest-VolumesSnapshotTestJSON-56850989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:58:40 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aebe798-3a55-48da-a31f-fe01c465c3a8]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:58:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-00eb8f12-eb9d-4313-a971-e412eaad7660 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:40 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d Apr 28 05:58:40 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:40 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-00eb8f12-eb9d-4313-a971-e412eaad7660 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d" returned: 0 in 0.529s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-00eb8f12-eb9d-4313-a971-e412eaad7660 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:40 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0 Apr 28 05:58:40 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:41 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-00eb8f12-eb9d-4313-a971-e412eaad7660 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0" returned: 0 in 0.518s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-00eb8f12-eb9d-4313-a971-e412eaad7660 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:41 devstack sudo[90409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0 Apr 28 05:58:41 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:41 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-00eb8f12-eb9d-4313-a971-e412eaad7660 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d.9b04c377-f996-4071-9a5b-7c2b3321a9e0" returned: 0 in 0.443s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:41 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-00eb8f12-eb9d-4313-a971-e412eaad7660 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-9b04c377-f996-4071-9a5b-7c2b3321a9e0" released by "_delete_snapshot" :: held 2.101s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:41 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-00eb8f12-eb9d-4313-a971-e412eaad7660 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-71a4f4bb-6974-4a37-a924-3867ec00ba8d" released by "delete_snapshot" :: held 2.125s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:41 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-00eb8f12-eb9d-4313-a971-e412eaad7660 tempest-VolumesSnapshotTestJSON-56850989 None] Created reservations ['2c1f3b5e-ff13-4151-ab4d-5737a2dc2a2e', '1a903bf0-c929-42d9-81ac-0694d832ef5c', 'de2b3ea7-19c7-4cf8-9285-dbffee4cf51d', '33760823-b1f1-4516-a04e-18054b37703b'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:58:41 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-00eb8f12-eb9d-4313-a971-e412eaad7660 tempest-VolumesSnapshotTestJSON-56850989 None] Delete snapshot completed successfully. Apr 28 05:58:41 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-00eb8f12-eb9d-4313-a971-e412eaad7660 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-9b04c377-f996-4071-9a5b-7c2b3321a9e0-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:42 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-35408c5e-a04c-4d11-851e-c768f811c0cb tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-71a4f4bb-6974-4a37-a924-3867ec00ba8d-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:58:42 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-35408c5e-a04c-4d11-851e-c768f811c0cb tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-71a4f4bb-6974-4a37-a924-3867ec00ba8d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:58:42 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:UPDATE=81,cinder:SELECT=85,cinder:INSERT=23,cinder:DELETE=7 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:58:42 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-35408c5e-a04c-4d11-851e-c768f811c0cb tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-quobyte-71a4f4bb-6974-4a37-a924-3867ec00ba8d" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:58:42 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-35408c5e-a04c-4d11-851e-c768f811c0cb tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-71a4f4bb-6974-4a37-a924-3867ec00ba8d" acquired by "delete_volume" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:58:42 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bdaedc-e901-4347-a1c7-a95c09785f1e]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:58:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35408c5e-a04c-4d11-851e-c768f811c0cb tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:43 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d Apr 28 05:58:43 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:43 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35408c5e-a04c-4d11-851e-c768f811c0cb tempest-VolumesSnapshotTestJSON-56850989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d" returned: 0 in 0.531s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35408c5e-a04c-4d11-851e-c768f811c0cb tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:43 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d Apr 28 05:58:43 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:43 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35408c5e-a04c-4d11-851e-c768f811c0cb tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-71a4f4bb-6974-4a37-a924-3867ec00ba8d" returned: 0 in 0.427s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:43 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-35408c5e-a04c-4d11-851e-c768f811c0cb tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-71a4f4bb-6974-4a37-a924-3867ec00ba8d" released by "delete_volume" :: held 1.015s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:43 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-35408c5e-a04c-4d11-851e-c768f811c0cb tempest-VolumesSnapshotTestJSON-56850989 None] Created reservations ['99d4b7eb-ed50-41f6-92aa-92f2d3da9c6e', '7070c931-ffc7-4cc9-89f5-3823dc207d6a', '1bfa3cb6-e850-4677-9cce-927fb327b97a', '51f261bc-07c4-46aa-976f-b396d2fb6364'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:58:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-35408c5e-a04c-4d11-851e-c768f811c0cb tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:58:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-35408c5e-a04c-4d11-851e-c768f811c0cb tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:58:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-35408c5e-a04c-4d11-851e-c768f811c0cb tempest-VolumesSnapshotTestJSON-56850989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:58:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-35408c5e-a04c-4d11-851e-c768f811c0cb tempest-VolumesSnapshotTestJSON-56850989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:58:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-35408c5e-a04c-4d11-851e-c768f811c0cb tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:58:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35408c5e-a04c-4d11-851e-c768f811c0cb tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:44 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:58:44 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:44 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35408c5e-a04c-4d11-851e-c768f811c0cb tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.457s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:44 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-35408c5e-a04c-4d11-851e-c768f811c0cb tempest-VolumesSnapshotTestJSON-56850989 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:58:44 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-35408c5e-a04c-4d11-851e-c768f811c0cb tempest-VolumesSnapshotTestJSON-56850989 None] Deleted volume successfully. Apr 28 05:58:44 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-35408c5e-a04c-4d11-851e-c768f811c0cb tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-71a4f4bb-6974-4a37-a924-3867ec00ba8d-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:45 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d8c17d11-2cf6-4f6e-9207-0893821b8bc1 tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-f5cd19e9-f5ab-485a-b42f-ee406c5b376f-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:58:45 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d8c17d11-2cf6-4f6e-9207-0893821b8bc1 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-f5cd19e9-f5ab-485a-b42f-ee406c5b376f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:58:45 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d8c17d11-2cf6-4f6e-9207-0893821b8bc1 tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "cinder-quobyte-f5cd19e9-f5ab-485a-b42f-ee406c5b376f" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:58:45 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d8c17d11-2cf6-4f6e-9207-0893821b8bc1 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-f5cd19e9-f5ab-485a-b42f-ee406c5b376f" acquired by "delete_volume" :: waited 0.019s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:58:45 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8b362e-bf09-4d64-ace4-a887d86c0f28]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:58:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d8c17d11-2cf6-4f6e-9207-0893821b8bc1 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:45 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f Apr 28 05:58:45 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:45 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d8c17d11-2cf6-4f6e-9207-0893821b8bc1 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f" returned: 0 in 0.531s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d8c17d11-2cf6-4f6e-9207-0893821b8bc1 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:45 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f Apr 28 05:58:45 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:46 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d8c17d11-2cf6-4f6e-9207-0893821b8bc1 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f5cd19e9-f5ab-485a-b42f-ee406c5b376f" returned: 0 in 0.455s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:46 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d8c17d11-2cf6-4f6e-9207-0893821b8bc1 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-quobyte-f5cd19e9-f5ab-485a-b42f-ee406c5b376f" released by "delete_volume" :: held 1.046s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:46 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-d8c17d11-2cf6-4f6e-9207-0893821b8bc1 tempest-VolumesSnapshotTestJSON-56850989 None] Created reservations ['14b7336c-f123-4cc1-b3b6-499e185e7393', '07c72e1b-cd8c-4c05-945e-df7e3f09cc1b', '5a5e8dcc-b1b9-406a-b755-60072f5481e0', '26ab677c-f5e7-40a3-9215-4ca9bde580f3'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:58:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d8c17d11-2cf6-4f6e-9207-0893821b8bc1 tempest-VolumesSnapshotTestJSON-56850989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:58:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d8c17d11-2cf6-4f6e-9207-0893821b8bc1 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:58:46 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d8c17d11-2cf6-4f6e-9207-0893821b8bc1 tempest-VolumesSnapshotTestJSON-56850989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:58:46 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d8c17d11-2cf6-4f6e-9207-0893821b8bc1 tempest-VolumesSnapshotTestJSON-56850989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:58:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d8c17d11-2cf6-4f6e-9207-0893821b8bc1 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:58:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d8c17d11-2cf6-4f6e-9207-0893821b8bc1 tempest-VolumesSnapshotTestJSON-56850989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:46 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:58:46 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:46 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d8c17d11-2cf6-4f6e-9207-0893821b8bc1 tempest-VolumesSnapshotTestJSON-56850989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.435s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:46 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-d8c17d11-2cf6-4f6e-9207-0893821b8bc1 tempest-VolumesSnapshotTestJSON-56850989 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:58:46 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-d8c17d11-2cf6-4f6e-9207-0893821b8bc1 tempest-VolumesSnapshotTestJSON-56850989 None] Deleted volume successfully. Apr 28 05:58:46 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d8c17d11-2cf6-4f6e-9207-0893821b8bc1 tempest-VolumesSnapshotTestJSON-56850989 None] Lock "cinder-f5cd19e9-f5ab-485a-b42f-ee406c5b376f-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Flow 'volume_create_manager' (68c772f9-0d85-42b6-b009-f68fd4d7defb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d1dda7-5b9d-46bb-b050-0bd2792461ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d1dda7-5b9d-46bb-b050-0bd2792461ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-47601754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3454636-caa4-42b0-a1df-8d4a5012a8c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16117a0b10b34e2d99c70d3fa8abf4c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:58:52Z,use_quota=True,user_id='29a1557c62eb4116ba37cc21cd0b50a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dab6ad9-4f2e-4776-9c88-4d0dd1f5c855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dab6ad9-4f2e-4776-9c88-4d0dd1f5c855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f431d778-f460-4976-96c6-83e091072ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f431d778-f460-4976-96c6-83e091072ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3454636-caa4-42b0-a1df-8d4a5012a8c7', 'volume_name': 'volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c9f596-fd0d-4547-a2a6-aca926b5ec63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c9f596-fd0d-4547-a2a6-aca926b5ec63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (465ed0cd-d2bb-4816-a187-c2b566c1c216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:52 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Volume c3454636-caa4-42b0-a1df-8d4a5012a8c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7', 'volume_size': 1} Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-47601754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3454636-caa4-42b0-a1df-8d4a5012a8c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16117a0b10b34e2d99c70d3fa8abf4c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:58:52Z,use_quota=True,user_id='29a1557c62eb4116ba37cc21cd0b50a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Creating volume c3454636-caa4-42b0-a1df-8d4a5012a8c7 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:58:52 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:52 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7 1073741824 Apr 28 05:58:52 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:52 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7 1073741824" returned: 0 in 0.605s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:52 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7 Apr 28 05:58:52 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:53 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7" returned: 0 in 0.462s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:53 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:58:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:58:53 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (465ed0cd-d2bb-4816-a187-c2b566c1c216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:53 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114c34cd-d3c4-4375-89ce-02ff6c38e8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:58:53 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Volume volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7 (c3454636-caa4-42b0-a1df-8d4a5012a8c7): created successfully Apr 28 05:58:53 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114c34cd-d3c4-4375-89ce-02ff6c38e8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:58:53 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Flow 'volume_create_manager' (68c772f9-0d85-42b6-b009-f68fd4d7defb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:58:53 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-cc5adc72-0266-4d6a-9fa1-0c8dde80bd0a tempest-VolumesSnapshotListTestJSON-939474548 None] Created volume successfully. Apr 28 05:58:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-405077ce-718a-45cb-bad6-8950f1a5be5a tempest-VolumesSnapshotListTestJSON-939474548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:58:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-405077ce-718a-45cb-bad6-8950f1a5be5a tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:58:54 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-405077ce-718a-45cb-bad6-8950f1a5be5a tempest-VolumesSnapshotListTestJSON-939474548 None] Creating offline snapshot 327d3112-fac3-409c-b0d2-dacde5483b10 of volume c3454636-caa4-42b0-a1df-8d4a5012a8c7 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:58:54 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[267c404d-d310-493b-9d11-c45f9eb65421]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:58:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-405077ce-718a-45cb-bad6-8950f1a5be5a tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:54 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7 Apr 28 05:58:54 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:54 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-405077ce-718a-45cb-bad6-8950f1a5be5a tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7" returned: 0 in 0.495s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-405077ce-718a-45cb-bad6-8950f1a5be5a tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:54 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10 1G Apr 28 05:58:54 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:55 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-405077ce-718a-45cb-bad6-8950f1a5be5a tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10 1G" returned: 0 in 0.589s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-405077ce-718a-45cb-bad6-8950f1a5be5a tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:55 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10 Apr 28 05:58:55 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:56 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-405077ce-718a-45cb-bad6-8950f1a5be5a tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10" returned: 0 in 0.490s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:56 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-405077ce-718a-45cb-bad6-8950f1a5be5a tempest-VolumesSnapshotListTestJSON-939474548 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10 is being set with open permissions: ugo+rw Apr 28 05:58:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-405077ce-718a-45cb-bad6-8950f1a5be5a tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:56 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10 Apr 28 05:58:56 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:56 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-405077ce-718a-45cb-bad6-8950f1a5be5a tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10" returned: 0 in 0.449s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-405077ce-718a-45cb-bad6-8950f1a5be5a tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:56 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.info Apr 28 05:58:56 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:56 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-405077ce-718a-45cb-bad6-8950f1a5be5a tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.info" returned: 0 in 0.447s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:56 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-405077ce-718a-45cb-bad6-8950f1a5be5a tempest-VolumesSnapshotListTestJSON-939474548 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.info is being set with open permissions: ugo+rw Apr 28 05:58:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-405077ce-718a-45cb-bad6-8950f1a5be5a tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:57 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.info Apr 28 05:58:57 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:57 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-405077ce-718a-45cb-bad6-8950f1a5be5a tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.info" returned: 0 in 0.462s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-405077ce-718a-45cb-bad6-8950f1a5be5a tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.021s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:58:57 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-405077ce-718a-45cb-bad6-8950f1a5be5a tempest-VolumesSnapshotListTestJSON-939474548 None] Create snapshot completed successfully Apr 28 05:58:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-765836a2-92d9-4643-a8ad-8922f93dbdad tempest-VolumesSnapshotListTestJSON-939474548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:58:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-765836a2-92d9-4643-a8ad-8922f93dbdad tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:58:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-765836a2-92d9-4643-a8ad-8922f93dbdad tempest-VolumesSnapshotListTestJSON-939474548 None] Creating offline snapshot 98ee9c40-8a41-4491-b287-686a4ee9da70 of volume c3454636-caa4-42b0-a1df-8d4a5012a8c7 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:58:58 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[6882e8e0-fda6-4ec1-b7d8-f18182c442b5]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:58:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-765836a2-92d9-4643-a8ad-8922f93dbdad tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:58 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10 Apr 28 05:58:58 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:59 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-765836a2-92d9-4643-a8ad-8922f93dbdad tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10" returned: 0 in 0.533s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:59 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-765836a2-92d9-4643-a8ad-8922f93dbdad tempest-VolumesSnapshotListTestJSON-939474548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:58:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-765836a2-92d9-4643-a8ad-8922f93dbdad tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:59 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70 1G Apr 28 05:58:59 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:58:59 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Apr 28 05:58:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-765836a2-92d9-4643-a8ad-8922f93dbdad tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70 1G" returned: 0 in 0.618s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:58:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-765836a2-92d9-4643-a8ad-8922f93dbdad tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:58:59 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70 Apr 28 05:58:59 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:00 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-765836a2-92d9-4643-a8ad-8922f93dbdad tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70" returned: 0 in 0.484s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:00 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-765836a2-92d9-4643-a8ad-8922f93dbdad tempest-VolumesSnapshotListTestJSON-939474548 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70 is being set with open permissions: ugo+rw Apr 28 05:59:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-765836a2-92d9-4643-a8ad-8922f93dbdad tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:00 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70 Apr 28 05:59:00 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:00 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-765836a2-92d9-4643-a8ad-8922f93dbdad tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70" returned: 0 in 0.439s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-765836a2-92d9-4643-a8ad-8922f93dbdad tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.169s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:59:00 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-765836a2-92d9-4643-a8ad-8922f93dbdad tempest-VolumesSnapshotListTestJSON-939474548 None] Create snapshot completed successfully Apr 28 05:59:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3880bcfd-fe83-4702-adb3-500ab29c3597 tempest-VolumesSnapshotListTestJSON-939474548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:59:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3880bcfd-fe83-4702-adb3-500ab29c3597 tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:59:02 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-3880bcfd-fe83-4702-adb3-500ab29c3597 tempest-VolumesSnapshotListTestJSON-939474548 None] Creating offline snapshot 54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c of volume c3454636-caa4-42b0-a1df-8d4a5012a8c7 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:59:02 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b260d11-19fe-433c-a45a-41f574cc53f2]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3880bcfd-fe83-4702-adb3-500ab29c3597 tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:02 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70 Apr 28 05:59:02 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:02 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3880bcfd-fe83-4702-adb3-500ab29c3597 tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70" returned: 0 in 0.530s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:02 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-3880bcfd-fe83-4702-adb3-500ab29c3597 tempest-VolumesSnapshotListTestJSON-939474548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:59:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3880bcfd-fe83-4702-adb3-500ab29c3597 tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:02 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c 1G Apr 28 05:59:02 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:03 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3880bcfd-fe83-4702-adb3-500ab29c3597 tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c 1G" returned: 0 in 0.647s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3880bcfd-fe83-4702-adb3-500ab29c3597 tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:03 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c Apr 28 05:59:03 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:03 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3880bcfd-fe83-4702-adb3-500ab29c3597 tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c" returned: 0 in 0.473s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:03 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-3880bcfd-fe83-4702-adb3-500ab29c3597 tempest-VolumesSnapshotListTestJSON-939474548 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c is being set with open permissions: ugo+rw Apr 28 05:59:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3880bcfd-fe83-4702-adb3-500ab29c3597 tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:03 devstack sudo[90512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c Apr 28 05:59:03 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:04 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3880bcfd-fe83-4702-adb3-500ab29c3597 tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c" returned: 0 in 0.440s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3880bcfd-fe83-4702-adb3-500ab29c3597 tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:59:04 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-3880bcfd-fe83-4702-adb3-500ab29c3597 tempest-VolumesSnapshotListTestJSON-939474548 None] Create snapshot completed successfully Apr 28 05:59:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] Acquiring lock "cinder-54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "cinder-54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] Acquiring lock "cinder-quobyte-c3454636-caa4-42b0-a1df-8d4a5012a8c7" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "cinder-quobyte-c3454636-caa4-42b0-a1df-8d4a5012a8c7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] Acquiring lock "cinder-quobyte-54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "cinder-quobyte-54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] Deleting offline snapshot 54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c of volume c3454636-caa4-42b0-a1df-8d4a5012a8c7 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:59:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] snapshot_file for this snap is: volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:59:05 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee135ae8-14cf-41d8-8217-cfd6a64f5d43]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:05 devstack sudo[90515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c Apr 28 05:59:05 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:06 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c" returned: 0 in 0.542s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:59:06 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c2a694-ee62-4d22-953f-ed2571802e22]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:06 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70 Apr 28 05:59:06 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:06 devstack cinder-volume[81829]: DEBUG oslo_service.periodic_task [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81829) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 05:59:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:59:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:59:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:59:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:59:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:59:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:06 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:59:06 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:06 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70" returned: 0 in 0.513s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:59:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:07 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c Apr 28 05:59:07 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:07 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.452s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:07 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:59:07 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c" returned: 0 in 0.638s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:07 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c Apr 28 05:59:07 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:08 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:08 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c" returned: 0 in 0.437s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:08 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "cinder-quobyte-54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c" released by "_delete_snapshot" :: held 2.218s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:08 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "cinder-quobyte-c3454636-caa4-42b0-a1df-8d4a5012a8c7" released by "delete_snapshot" :: held 2.242s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:08 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] Created reservations ['99218ffb-669e-4ac2-b1af-bac5e6ba7a63', '82620eff-ede0-43b4-ae62-319332754ec9', '86c4ae37-3e94-4b7d-9483-63c38133021d', 'd1d076ba-e93f-4834-8ea2-979c5a4aa923'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:59:08 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] Delete snapshot completed successfully. Apr 28 05:59:08 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-40e5a438-784a-457b-afec-34d483f8a2d6 tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "cinder-54e06102-f3ff-47ea-9f0a-c7c3b5ac4c6c-delete_snapshot" released by "delete_snapshot" :: held 2.378s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:09 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] Acquiring lock "cinder-98ee9c40-8a41-4491-b287-686a4ee9da70-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:09 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "cinder-98ee9c40-8a41-4491-b287-686a4ee9da70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:09 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] Acquiring lock "cinder-quobyte-c3454636-caa4-42b0-a1df-8d4a5012a8c7" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:09 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "cinder-quobyte-c3454636-caa4-42b0-a1df-8d4a5012a8c7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:09 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] Acquiring lock "cinder-quobyte-98ee9c40-8a41-4491-b287-686a4ee9da70" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:09 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "cinder-quobyte-98ee9c40-8a41-4491-b287-686a4ee9da70" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] Deleting offline snapshot 98ee9c40-8a41-4491-b287-686a4ee9da70 of volume c3454636-caa4-42b0-a1df-8d4a5012a8c7 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:59:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] snapshot_file for this snap is: volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:59:09 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fdcb6a-367d-42ab-b388-613ea6c0ef04]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:09 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70 Apr 28 05:59:09 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:09 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70" returned: 0 in 0.516s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:59:09 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed62050-bf4f-4d1a-81d4-41a150a78b9b]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:09 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10 Apr 28 05:59:09 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:10 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10" returned: 0 in 0.524s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:10 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:59:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:10 devstack sudo[90548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70 Apr 28 05:59:10 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:10 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70" returned: 0 in 0.574s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:10 devstack sudo[90553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70 Apr 28 05:59:10 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:11 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.98ee9c40-8a41-4491-b287-686a4ee9da70" returned: 0 in 0.461s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:11 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "cinder-quobyte-98ee9c40-8a41-4491-b287-686a4ee9da70" released by "_delete_snapshot" :: held 2.168s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:11 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "cinder-quobyte-c3454636-caa4-42b0-a1df-8d4a5012a8c7" released by "delete_snapshot" :: held 2.189s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:11 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] Created reservations ['fd59ee05-80c0-4cd7-acec-786e325a33c2', '5de0ddd0-600e-4aac-b3dd-a4e2c351a9ed', '72347d72-172d-421d-807d-c8f1b6e1f91f', 'f0d3c8c4-0892-4d5d-bdf9-09129d890017'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:59:11 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] Delete snapshot completed successfully. Apr 28 05:59:11 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1277d159-4a74-4b02-8177-faf706a87d99 tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "cinder-98ee9c40-8a41-4491-b287-686a4ee9da70-delete_snapshot" released by "delete_snapshot" :: held 2.315s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:12 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-755ea301-ae59-4c38-8f44-5a83e9757a7d tempest-VolumesSnapshotListTestJSON-939474548 None] Acquiring lock "cinder-327d3112-fac3-409c-b0d2-dacde5483b10-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:12 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-755ea301-ae59-4c38-8f44-5a83e9757a7d tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "cinder-327d3112-fac3-409c-b0d2-dacde5483b10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:12 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-755ea301-ae59-4c38-8f44-5a83e9757a7d tempest-VolumesSnapshotListTestJSON-939474548 None] Acquiring lock "cinder-quobyte-c3454636-caa4-42b0-a1df-8d4a5012a8c7" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:12 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-755ea301-ae59-4c38-8f44-5a83e9757a7d tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "cinder-quobyte-c3454636-caa4-42b0-a1df-8d4a5012a8c7" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:12 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-755ea301-ae59-4c38-8f44-5a83e9757a7d tempest-VolumesSnapshotListTestJSON-939474548 None] Acquiring lock "cinder-quobyte-327d3112-fac3-409c-b0d2-dacde5483b10" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:12 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-755ea301-ae59-4c38-8f44-5a83e9757a7d tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "cinder-quobyte-327d3112-fac3-409c-b0d2-dacde5483b10" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:12 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-755ea301-ae59-4c38-8f44-5a83e9757a7d tempest-VolumesSnapshotListTestJSON-939474548 None] Deleting offline snapshot 327d3112-fac3-409c-b0d2-dacde5483b10 of volume c3454636-caa4-42b0-a1df-8d4a5012a8c7 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:59:12 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-755ea301-ae59-4c38-8f44-5a83e9757a7d tempest-VolumesSnapshotListTestJSON-939474548 None] snapshot_file for this snap is: volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:59:12 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66835e0-f541-4182-a36e-2e2d09b81a46]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-755ea301-ae59-4c38-8f44-5a83e9757a7d tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:12 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10 Apr 28 05:59:12 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:12 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-755ea301-ae59-4c38-8f44-5a83e9757a7d tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10" returned: 0 in 0.501s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:12 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-755ea301-ae59-4c38-8f44-5a83e9757a7d tempest-VolumesSnapshotListTestJSON-939474548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:59:12 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3540c0d-deb9-4acb-ae31-539d3a6c877c]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-755ea301-ae59-4c38-8f44-5a83e9757a7d tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:12 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7 Apr 28 05:59:12 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:13 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-755ea301-ae59-4c38-8f44-5a83e9757a7d tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7" returned: 0 in 0.521s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-755ea301-ae59-4c38-8f44-5a83e9757a7d tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:13 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10 Apr 28 05:59:13 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:13 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-755ea301-ae59-4c38-8f44-5a83e9757a7d tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10" returned: 0 in 0.549s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-755ea301-ae59-4c38-8f44-5a83e9757a7d tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:13 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10 Apr 28 05:59:13 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:14 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-755ea301-ae59-4c38-8f44-5a83e9757a7d tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7.327d3112-fac3-409c-b0d2-dacde5483b10" returned: 0 in 0.448s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:14 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-755ea301-ae59-4c38-8f44-5a83e9757a7d tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "cinder-quobyte-327d3112-fac3-409c-b0d2-dacde5483b10" released by "_delete_snapshot" :: held 2.123s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:14 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-755ea301-ae59-4c38-8f44-5a83e9757a7d tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "cinder-quobyte-c3454636-caa4-42b0-a1df-8d4a5012a8c7" released by "delete_snapshot" :: held 2.146s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:14 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-755ea301-ae59-4c38-8f44-5a83e9757a7d tempest-VolumesSnapshotListTestJSON-939474548 None] Created reservations ['abe1290e-dc11-4724-96aa-619d1901e948', '55d9df30-dd5a-4100-9e53-2cc6147624aa', 'ba3f118c-88be-4e75-8558-6a76ed3e1470', 'c7a152d5-876c-4dff-8f8e-4e3cd9c79945'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:59:14 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-755ea301-ae59-4c38-8f44-5a83e9757a7d tempest-VolumesSnapshotListTestJSON-939474548 None] Delete snapshot completed successfully. Apr 28 05:59:14 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-755ea301-ae59-4c38-8f44-5a83e9757a7d tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "cinder-327d3112-fac3-409c-b0d2-dacde5483b10-delete_snapshot" released by "delete_snapshot" :: held 2.269s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-fd2bce5c-96b2-4c7c-84f6-e575f9a283fb tempest-VolumesSnapshotListTestJSON-939474548 None] Acquiring lock "cinder-c3454636-caa4-42b0-a1df-8d4a5012a8c7-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-fd2bce5c-96b2-4c7c-84f6-e575f9a283fb tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "cinder-c3454636-caa4-42b0-a1df-8d4a5012a8c7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-fd2bce5c-96b2-4c7c-84f6-e575f9a283fb tempest-VolumesSnapshotListTestJSON-939474548 None] Acquiring lock "cinder-quobyte-c3454636-caa4-42b0-a1df-8d4a5012a8c7" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:15 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-fd2bce5c-96b2-4c7c-84f6-e575f9a283fb tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "cinder-quobyte-c3454636-caa4-42b0-a1df-8d4a5012a8c7" acquired by "delete_volume" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:15 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[60939def-2201-4f6e-85bb-cc163ec8cc0a]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-fd2bce5c-96b2-4c7c-84f6-e575f9a283fb tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:15 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7 Apr 28 05:59:15 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:16 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-fd2bce5c-96b2-4c7c-84f6-e575f9a283fb tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7" returned: 0 in 0.520s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-fd2bce5c-96b2-4c7c-84f6-e575f9a283fb tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:16 devstack sudo[90580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7 Apr 28 05:59:16 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:16 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-fd2bce5c-96b2-4c7c-84f6-e575f9a283fb tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c3454636-caa4-42b0-a1df-8d4a5012a8c7" returned: 0 in 0.422s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:16 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-fd2bce5c-96b2-4c7c-84f6-e575f9a283fb tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "cinder-quobyte-c3454636-caa4-42b0-a1df-8d4a5012a8c7" released by "delete_volume" :: held 1.002s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:16 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-fd2bce5c-96b2-4c7c-84f6-e575f9a283fb tempest-VolumesSnapshotListTestJSON-939474548 None] Created reservations ['4effe4f1-1da1-439f-8050-1ea0f5e4c74b', '6a068a90-31b0-403b-83ba-296157c92f47', 'a668121f-0c7b-41f4-b57c-a5b79995723f', '7180104c-a32a-4e6f-b34f-16415fa21518'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:59:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-fd2bce5c-96b2-4c7c-84f6-e575f9a283fb tempest-VolumesSnapshotListTestJSON-939474548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:59:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-fd2bce5c-96b2-4c7c-84f6-e575f9a283fb tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:59:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-fd2bce5c-96b2-4c7c-84f6-e575f9a283fb tempest-VolumesSnapshotListTestJSON-939474548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:59:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-fd2bce5c-96b2-4c7c-84f6-e575f9a283fb tempest-VolumesSnapshotListTestJSON-939474548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:59:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-fd2bce5c-96b2-4c7c-84f6-e575f9a283fb tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:59:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-fd2bce5c-96b2-4c7c-84f6-e575f9a283fb tempest-VolumesSnapshotListTestJSON-939474548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:16 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:59:16 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:17 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-fd2bce5c-96b2-4c7c-84f6-e575f9a283fb tempest-VolumesSnapshotListTestJSON-939474548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.430s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:17 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-fd2bce5c-96b2-4c7c-84f6-e575f9a283fb tempest-VolumesSnapshotListTestJSON-939474548 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:59:17 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-fd2bce5c-96b2-4c7c-84f6-e575f9a283fb tempest-VolumesSnapshotListTestJSON-939474548 None] Deleted volume successfully. Apr 28 05:59:17 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-fd2bce5c-96b2-4c7c-84f6-e575f9a283fb tempest-VolumesSnapshotListTestJSON-939474548 None] Lock "cinder-c3454636-caa4-42b0-a1df-8d4a5012a8c7-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:19 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:59:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Flow 'volume_create_manager' (2bedf545-797e-4155-a804-b7e3150e05da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:59:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d25373-9b73-43e3-8001-7fda922aeb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d25373-9b73-43e3-8001-7fda922aeb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-671268315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50393a63-6c67-4ab5-bae8-9995c983c416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e10f8f2f3b0477bba8d4b2c9e52eb37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:59:20Z,use_quota=True,user_id='207eb1c72b004b3482ae017ab25fd2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1befd1-79c0-430c-a372-5fdaeae7159e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1befd1-79c0-430c-a372-5fdaeae7159e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc65efe-530d-4977-b7d7-b8dcc4352306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc65efe-530d-4977-b7d7-b8dcc4352306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50393a63-6c67-4ab5-bae8-9995c983c416', 'volume_name': 'volume-50393a63-6c67-4ab5-bae8-9995c983c416', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c7802b-c3e7-4bb9-8e16-1aad47fdd801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c7802b-c3e7-4bb9-8e16-1aad47fdd801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db842866-d2e3-43f8-8f2c-f3c0655543ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:19 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Volume 50393a63-6c67-4ab5-bae8-9995c983c416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50393a63-6c67-4ab5-bae8-9995c983c416', 'volume_size': 1} Apr 28 05:59:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:59:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:59:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-671268315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50393a63-6c67-4ab5-bae8-9995c983c416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e10f8f2f3b0477bba8d4b2c9e52eb37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:59:20Z,use_quota=True,user_id='207eb1c72b004b3482ae017ab25fd2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:59:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Creating volume 50393a63-6c67-4ab5-bae8-9995c983c416 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:59:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:59:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:59:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:59:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:59:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:59:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:59:20 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:59:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:20 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416 1073741824 Apr 28 05:59:20 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:20 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416 1073741824" returned: 0 in 0.604s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:20 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416 Apr 28 05:59:20 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:21 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416" returned: 0 in 0.458s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:59:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:59:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db842866-d2e3-43f8-8f2c-f3c0655543ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50393a63-6c67-4ab5-bae8-9995c983c416', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4e8a89-6618-4322-952a-bb47354b1af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:21 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Volume volume-50393a63-6c67-4ab5-bae8-9995c983c416 (50393a63-6c67-4ab5-bae8-9995c983c416): created successfully Apr 28 05:59:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4e8a89-6618-4322-952a-bb47354b1af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:21 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Flow 'volume_create_manager' (2bedf545-797e-4155-a804-b7e3150e05da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:59:21 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-37d0779c-e3b9-4ffc-a379-74c30678caa2 tempest-VolumeDependencyTests-201346684 None] Created volume successfully. Apr 28 05:59:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-635c263c-a7fb-4da8-bc9a-019906c4931a tempest-VolumeDependencyTests-201346684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:59:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-635c263c-a7fb-4da8-bc9a-019906c4931a tempest-VolumeDependencyTests-201346684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:59:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-635c263c-a7fb-4da8-bc9a-019906c4931a tempest-VolumeDependencyTests-201346684 None] Creating offline snapshot e268ed81-b698-478d-a6b3-062642782c6a of volume 50393a63-6c67-4ab5-bae8-9995c983c416 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:59:22 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82686b9-2bb9-44f1-a1fd-fee3420c95e1]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-635c263c-a7fb-4da8-bc9a-019906c4931a tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:22 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416 Apr 28 05:59:22 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:22 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-635c263c-a7fb-4da8-bc9a-019906c4931a tempest-VolumeDependencyTests-201346684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416" returned: 0 in 0.526s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-635c263c-a7fb-4da8-bc9a-019906c4931a tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:22 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a 1G Apr 28 05:59:22 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:23 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-635c263c-a7fb-4da8-bc9a-019906c4931a tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a 1G" returned: 0 in 0.592s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-635c263c-a7fb-4da8-bc9a-019906c4931a tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50393a63-6c67-4ab5-bae8-9995c983c416 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:23 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50393a63-6c67-4ab5-bae8-9995c983c416 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a Apr 28 05:59:23 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:23 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-635c263c-a7fb-4da8-bc9a-019906c4931a tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50393a63-6c67-4ab5-bae8-9995c983c416 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a" returned: 0 in 0.476s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:23 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-635c263c-a7fb-4da8-bc9a-019906c4931a tempest-VolumeDependencyTests-201346684 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a is being set with open permissions: ugo+rw Apr 28 05:59:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-635c263c-a7fb-4da8-bc9a-019906c4931a tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:23 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a Apr 28 05:59:23 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:24 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-635c263c-a7fb-4da8-bc9a-019906c4931a tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a" returned: 0 in 0.439s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-635c263c-a7fb-4da8-bc9a-019906c4931a tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:24 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.info Apr 28 05:59:24 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:24 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-635c263c-a7fb-4da8-bc9a-019906c4931a tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.info" returned: 0 in 0.435s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:24 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-635c263c-a7fb-4da8-bc9a-019906c4931a tempest-VolumeDependencyTests-201346684 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.info is being set with open permissions: ugo+rw Apr 28 05:59:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-635c263c-a7fb-4da8-bc9a-019906c4931a tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:24 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.info Apr 28 05:59:24 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:25 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-635c263c-a7fb-4da8-bc9a-019906c4931a tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.info" returned: 0 in 0.425s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-635c263c-a7fb-4da8-bc9a-019906c4931a tempest-VolumeDependencyTests-201346684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.977s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:59:25 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-635c263c-a7fb-4da8-bc9a-019906c4931a tempest-VolumeDependencyTests-201346684 None] Create snapshot completed successfully Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Flow 'volume_create_manager' (3bc61a8e-440d-4a43-aa15-0961ba0267ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142954cd-4efc-46b9-b995-37cc1eeec00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142954cd-4efc-46b9-b995-37cc1eeec00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-908981331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2891e99-0652-4835-b91c-71986ad9a203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e10f8f2f3b0477bba8d4b2c9e52eb37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e268ed81-b698-478d-a6b3-062642782c6a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:59:26Z,use_quota=True,user_id='207eb1c72b004b3482ae017ab25fd2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d301f9f-c61b-4b96-9066-0ec27a368f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d301f9f-c61b-4b96-9066-0ec27a368f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a57057-fbee-4c46-b6f9-55216c788d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a57057-fbee-4c46-b6f9-55216c788d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b2891e99-0652-4835-b91c-71986ad9a203', 'volume_name': 'volume-b2891e99-0652-4835-b91c-71986ad9a203', 'volume_size': 1, 'snapshot_id': 'e268ed81-b698-478d-a6b3-062642782c6a'}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c5e5ae-a8fc-4439-81d4-6519d20d8def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c5e5ae-a8fc-4439-81d4-6519d20d8def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64917ee6-37e5-4c10-a55b-ccc2ec698d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:25 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Volume b2891e99-0652-4835-b91c-71986ad9a203: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b2891e99-0652-4835-b91c-71986ad9a203', 'volume_size': 1, 'snapshot_id': 'e268ed81-b698-478d-a6b3-062642782c6a'} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Acquiring lock "cinder-quobyte-e268ed81-b698-478d-a6b3-062642782c6a-b2891e99-0652-4835-b91c-71986ad9a203" by "_create_volume_from_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Lock "cinder-quobyte-e268ed81-b698-478d-a6b3-062642782c6a-b2891e99-0652-4835-b91c-71986ad9a203" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Creating volume b2891e99-0652-4835-b91c-71986ad9a203 from snapshot e268ed81-b698-478d-a6b3-062642782c6a {{(pid=81829) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Acquiring lock "cinder-quobyte-b2891e99-0652-4835-b91c-71986ad9a203" by "_copy_volume_from_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Lock "cinder-quobyte-b2891e99-0652-4835-b91c-71986ad9a203" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] snapshot: e268ed81-b698-478d-a6b3-062642782c6a, volume: b2891e99-0652-4835-b91c-71986ad9a203, {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72c0fc1-ee40-4338-a381-2bb692678b2d]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:25 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a Apr 28 05:59:25 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:26 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a" returned: 0 in 0.518s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50393a63-6c67-4ab5-bae8-9995c983c416(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:59:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] will copy from snapshot at /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416 {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 05:59:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Creating direct copy from snapshot {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 05:59:26 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[de706aa6-7d71-4480-b806-b583dc6e1c60]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:26 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416 Apr 28 05:59:26 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:26 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416" returned: 0 in 0.506s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:26 devstack cinder-volume[81829]: DEBUG cinder.utils [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Path /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b2891e99-0652-4835-b91c-71986ad9a203 not found in is_blk_device check {{(pid=81829) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 05:59:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b2891e99-0652-4835-b91c-71986ad9a203 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:26 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b2891e99-0652-4835-b91c-71986ad9a203 Apr 28 05:59:26 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:31 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b2891e99-0652-4835-b91c-71986ad9a203" returned: 0 in 4.601s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:31 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfd08d4-87fe-4c8a-8c22-ea6c7d11390a]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:31 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416 Apr 28 05:59:31 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:32 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416" returned: 0 in 0.645s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:32 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Image conversion details: src /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416, size 1024.00 MB, duration 4.60 sec, destination /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b2891e99-0652-4835-b91c-71986ad9a203 {{(pid=81829) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:59:32 devstack cinder-volume[81829]: INFO cinder.image.image_utils [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Converted 1024.00 MB image at 222.47 MB/s Apr 28 05:59:32 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b2891e99-0652-4835-b91c-71986ad9a203 is being set with open permissions: ugo+rw Apr 28 05:59:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b2891e99-0652-4835-b91c-71986ad9a203 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:32 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b2891e99-0652-4835-b91c-71986ad9a203 Apr 28 05:59:32 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:32 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b2891e99-0652-4835-b91c-71986ad9a203" returned: 0 in 0.431s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:32 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Lock "cinder-quobyte-b2891e99-0652-4835-b91c-71986ad9a203" released by "_copy_volume_from_snapshot" :: held 6.792s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:32 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Lock "cinder-quobyte-e268ed81-b698-478d-a6b3-062642782c6a-b2891e99-0652-4835-b91c-71986ad9a203" released by "_create_volume_from_snapshot" :: held 6.822s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.843s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:59:32 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64917ee6-37e5-4c10-a55b-ccc2ec698d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2891e99-0652-4835-b91c-71986ad9a203', 'volume_size': 1, 'snapshot_id': 'e268ed81-b698-478d-a6b3-062642782c6a'}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:32 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e019300a-ebfc-4276-8626-696aa79769e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:32 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Volume volume-b2891e99-0652-4835-b91c-71986ad9a203 (b2891e99-0652-4835-b91c-71986ad9a203): created successfully Apr 28 05:59:32 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e019300a-ebfc-4276-8626-696aa79769e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:32 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Flow 'volume_create_manager' (3bc61a8e-440d-4a43-aa15-0961ba0267ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:59:32 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-f8cb31d8-b0ee-46cc-8e93-9ac984b0a6c9 tempest-VolumeDependencyTests-201346684 None] Created volume successfully. Apr 28 05:59:33 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2df0dd3d-8dcc-499a-a7ab-cac2c415b2b9 tempest-VolumeDependencyTests-201346684 None] Acquiring lock "cinder-e268ed81-b698-478d-a6b3-062642782c6a-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:33 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2df0dd3d-8dcc-499a-a7ab-cac2c415b2b9 tempest-VolumeDependencyTests-201346684 None] Lock "cinder-e268ed81-b698-478d-a6b3-062642782c6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:33 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2df0dd3d-8dcc-499a-a7ab-cac2c415b2b9 tempest-VolumeDependencyTests-201346684 None] Acquiring lock "cinder-quobyte-50393a63-6c67-4ab5-bae8-9995c983c416" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:33 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2df0dd3d-8dcc-499a-a7ab-cac2c415b2b9 tempest-VolumeDependencyTests-201346684 None] Lock "cinder-quobyte-50393a63-6c67-4ab5-bae8-9995c983c416" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:33 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2df0dd3d-8dcc-499a-a7ab-cac2c415b2b9 tempest-VolumeDependencyTests-201346684 None] Acquiring lock "cinder-quobyte-e268ed81-b698-478d-a6b3-062642782c6a" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:33 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2df0dd3d-8dcc-499a-a7ab-cac2c415b2b9 tempest-VolumeDependencyTests-201346684 None] Lock "cinder-quobyte-e268ed81-b698-478d-a6b3-062642782c6a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-2df0dd3d-8dcc-499a-a7ab-cac2c415b2b9 tempest-VolumeDependencyTests-201346684 None] Deleting offline snapshot e268ed81-b698-478d-a6b3-062642782c6a of volume 50393a63-6c67-4ab5-bae8-9995c983c416 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:59:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-2df0dd3d-8dcc-499a-a7ab-cac2c415b2b9 tempest-VolumeDependencyTests-201346684 None] snapshot_file for this snap is: volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:59:33 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f42884-e903-4d82-8657-ae1a1aca3f66]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2df0dd3d-8dcc-499a-a7ab-cac2c415b2b9 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:33 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a Apr 28 05:59:33 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:33 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2df0dd3d-8dcc-499a-a7ab-cac2c415b2b9 tempest-VolumeDependencyTests-201346684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a" returned: 0 in 0.520s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-2df0dd3d-8dcc-499a-a7ab-cac2c415b2b9 tempest-VolumeDependencyTests-201346684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50393a63-6c67-4ab5-bae8-9995c983c416(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:59:33 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6785c6c-4ae9-430e-b0df-31f1171662f4]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2df0dd3d-8dcc-499a-a7ab-cac2c415b2b9 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:34 devstack sudo[90689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416 Apr 28 05:59:34 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:34 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2df0dd3d-8dcc-499a-a7ab-cac2c415b2b9 tempest-VolumeDependencyTests-201346684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416" returned: 0 in 0.524s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2df0dd3d-8dcc-499a-a7ab-cac2c415b2b9 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:34 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a Apr 28 05:59:34 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:34 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2df0dd3d-8dcc-499a-a7ab-cac2c415b2b9 tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a" returned: 0 in 0.515s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2df0dd3d-8dcc-499a-a7ab-cac2c415b2b9 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:35 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a Apr 28 05:59:35 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:35 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2df0dd3d-8dcc-499a-a7ab-cac2c415b2b9 tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416.e268ed81-b698-478d-a6b3-062642782c6a" returned: 0 in 0.435s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:35 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2df0dd3d-8dcc-499a-a7ab-cac2c415b2b9 tempest-VolumeDependencyTests-201346684 None] Lock "cinder-quobyte-e268ed81-b698-478d-a6b3-062642782c6a" released by "_delete_snapshot" :: held 2.090s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:35 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2df0dd3d-8dcc-499a-a7ab-cac2c415b2b9 tempest-VolumeDependencyTests-201346684 None] Lock "cinder-quobyte-50393a63-6c67-4ab5-bae8-9995c983c416" released by "delete_snapshot" :: held 2.113s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:35 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-2df0dd3d-8dcc-499a-a7ab-cac2c415b2b9 tempest-VolumeDependencyTests-201346684 None] Created reservations ['f868b01e-5cf5-4798-93f0-34be13ee650a', 'e85abd4f-7c61-40c9-8c45-1cb7b07caffe', '87d55b5b-fadd-4517-bfff-022a941a0f96', '4ca17cfc-6a3b-49c8-a8ea-3aaaadd33c80'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:59:35 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-2df0dd3d-8dcc-499a-a7ab-cac2c415b2b9 tempest-VolumeDependencyTests-201346684 None] Delete snapshot completed successfully. Apr 28 05:59:35 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2df0dd3d-8dcc-499a-a7ab-cac2c415b2b9 tempest-VolumeDependencyTests-201346684 None] Lock "cinder-e268ed81-b698-478d-a6b3-062642782c6a-delete_snapshot" released by "delete_snapshot" :: held 2.242s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-df52b486-5c89-4b4e-8737-74e6ea8bc15c tempest-VolumeDependencyTests-201346684 None] Acquiring lock "cinder-50393a63-6c67-4ab5-bae8-9995c983c416-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-df52b486-5c89-4b4e-8737-74e6ea8bc15c tempest-VolumeDependencyTests-201346684 None] Lock "cinder-50393a63-6c67-4ab5-bae8-9995c983c416-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-df52b486-5c89-4b4e-8737-74e6ea8bc15c tempest-VolumeDependencyTests-201346684 None] Acquiring lock "cinder-quobyte-50393a63-6c67-4ab5-bae8-9995c983c416" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:36 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-df52b486-5c89-4b4e-8737-74e6ea8bc15c tempest-VolumeDependencyTests-201346684 None] Lock "cinder-quobyte-50393a63-6c67-4ab5-bae8-9995c983c416" acquired by "delete_volume" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:36 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2f40f0-d374-48e7-897f-481869073afd]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-df52b486-5c89-4b4e-8737-74e6ea8bc15c tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:36 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416 Apr 28 05:59:36 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:37 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-df52b486-5c89-4b4e-8737-74e6ea8bc15c tempest-VolumeDependencyTests-201346684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416" returned: 0 in 0.506s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-df52b486-5c89-4b4e-8737-74e6ea8bc15c tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:37 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416 Apr 28 05:59:37 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:37 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-df52b486-5c89-4b4e-8737-74e6ea8bc15c tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-50393a63-6c67-4ab5-bae8-9995c983c416" returned: 0 in 0.448s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-df52b486-5c89-4b4e-8737-74e6ea8bc15c tempest-VolumeDependencyTests-201346684 None] Lock "cinder-quobyte-50393a63-6c67-4ab5-bae8-9995c983c416" released by "delete_volume" :: held 1.014s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:37 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-df52b486-5c89-4b4e-8737-74e6ea8bc15c tempest-VolumeDependencyTests-201346684 None] Created reservations ['c41a6713-df98-4ee4-852e-8ea87ac7f6f5', '92e4e2f7-def3-4902-8a86-342f3c870d82', 'd4617b14-c8fc-4130-89f7-a659dac5d326', 'bd04d427-7655-4dc4-b06d-11b5dfa54ea1'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:59:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-df52b486-5c89-4b4e-8737-74e6ea8bc15c tempest-VolumeDependencyTests-201346684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:59:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-df52b486-5c89-4b4e-8737-74e6ea8bc15c tempest-VolumeDependencyTests-201346684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:59:37 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-df52b486-5c89-4b4e-8737-74e6ea8bc15c tempest-VolumeDependencyTests-201346684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:59:37 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-df52b486-5c89-4b4e-8737-74e6ea8bc15c tempest-VolumeDependencyTests-201346684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:59:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-df52b486-5c89-4b4e-8737-74e6ea8bc15c tempest-VolumeDependencyTests-201346684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:59:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-df52b486-5c89-4b4e-8737-74e6ea8bc15c tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:37 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:59:37 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:38 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-df52b486-5c89-4b4e-8737-74e6ea8bc15c tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.436s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:38 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-df52b486-5c89-4b4e-8737-74e6ea8bc15c tempest-VolumeDependencyTests-201346684 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:59:38 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-df52b486-5c89-4b4e-8737-74e6ea8bc15c tempest-VolumeDependencyTests-201346684 None] Deleted volume successfully. Apr 28 05:59:38 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-df52b486-5c89-4b4e-8737-74e6ea8bc15c tempest-VolumeDependencyTests-201346684 None] Lock "cinder-50393a63-6c67-4ab5-bae8-9995c983c416-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Flow 'volume_create_manager' (fa409051-5600-43ae-86e3-467e1ca9c7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6466187b-31cf-498c-8269-e2c80e5337aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:UPDATE=82,cinder:SELECT=71,cinder:INSERT=20,cinder:DELETE=6 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6466187b-31cf-498c-8269-e2c80e5337aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-168154258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d3bb53f-959a-47ea-ac06-951f98d13b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e10f8f2f3b0477bba8d4b2c9e52eb37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:59:39Z,use_quota=True,user_id='207eb1c72b004b3482ae017ab25fd2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ebc450-f844-404d-bc73-a546f917a8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ebc450-f844-404d-bc73-a546f917a8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b35a868b-27ef-41e9-9975-e7a8b2116d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b35a868b-27ef-41e9-9975-e7a8b2116d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d3bb53f-959a-47ea-ac06-951f98d13b1c', 'volume_name': 'volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497abd04-b6ce-4a33-85b9-f6da2b157b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497abd04-b6ce-4a33-85b9-f6da2b157b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e15d27e6-05b5-4f1a-9611-d6394962de52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:39 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Volume 5d3bb53f-959a-47ea-ac06-951f98d13b1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c', 'volume_size': 1} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-168154258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d3bb53f-959a-47ea-ac06-951f98d13b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e10f8f2f3b0477bba8d4b2c9e52eb37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T03:59:39Z,use_quota=True,user_id='207eb1c72b004b3482ae017ab25fd2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Creating volume 5d3bb53f-959a-47ea-ac06-951f98d13b1c {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 05:59:39 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:39 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c 1073741824 Apr 28 05:59:39 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:39 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c 1073741824" returned: 0 in 0.610s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:39 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c Apr 28 05:59:39 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:40 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c" returned: 0 in 0.456s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 05:59:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:59:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e15d27e6-05b5-4f1a-9611-d6394962de52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960a1a17-525d-4ff2-b721-9fea230595d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:40 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Volume volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c (5d3bb53f-959a-47ea-ac06-951f98d13b1c): created successfully Apr 28 05:59:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960a1a17-525d-4ff2-b721-9fea230595d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Flow 'volume_create_manager' (fa409051-5600-43ae-86e3-467e1ca9c7c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:59:40 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-3ff1fed6-8e5c-4457-9128-ca4be17ca7f9 tempest-VolumeDependencyTests-201346684 None] Created volume successfully. Apr 28 05:59:41 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 05:59:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Flow 'volume_create_manager' (11a4d111-f1c8-4969-88d7-a0e1702babcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:59:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9fc6a1-e852-4176-81ad-c49510d92530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9fc6a1-e852-4176-81ad-c49510d92530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T03:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1448903059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb8c043a-ca8e-497f-a5ac-ca61e631a539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e10f8f2f3b0477bba8d4b2c9e52eb37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T03:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5d3bb53f-959a-47ea-ac06-951f98d13b1c,status='creating',terminated_at=None,updated_at=2026-04-28T03:59:41Z,use_quota=True,user_id='207eb1c72b004b3482ae017ab25fd2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851fe7ed-b5e2-4aa0-aa94-b60ced5917d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (851fe7ed-b5e2-4aa0-aa94-b60ced5917d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (825688c3-a02e-4553-8576-ff28329c609e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (825688c3-a02e-4553-8576-ff28329c609e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cb8c043a-ca8e-497f-a5ac-ca61e631a539', 'volume_name': 'volume-cb8c043a-ca8e-497f-a5ac-ca61e631a539', 'volume_size': 1, 'source_volid': '5d3bb53f-959a-47ea-ac06-951f98d13b1c', 'source_volstatus': 'available'}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52547f8-e08e-43da-8c0e-7a7af6994cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52547f8-e08e-43da-8c0e-7a7af6994cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d5a4c0-c187-43be-b006-7b62adfabc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:41 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Volume cb8c043a-ca8e-497f-a5ac-ca61e631a539: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cb8c043a-ca8e-497f-a5ac-ca61e631a539', 'volume_size': 1, 'source_volid': '5d3bb53f-959a-47ea-ac06-951f98d13b1c', 'source_volstatus': 'available'} Apr 28 05:59:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:59:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:59:41 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Cloning volume 5d3bb53f-959a-47ea-ac06-951f98d13b1c to volume cb8c043a-ca8e-497f-a5ac-ca61e631a539 Apr 28 05:59:41 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Creating offline snapshot 0effe51e-6284-4673-a7bf-7a96bed47be4 of volume 5d3bb53f-959a-47ea-ac06-951f98d13b1c {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 05:59:41 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5d5efc-cd26-423d-b213-7940755d5176]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:41 devstack sudo[90722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c Apr 28 05:59:41 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:42 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c" returned: 0 in 0.502s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:42 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4 1G Apr 28 05:59:42 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:42 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4 1G" returned: 0 in 0.601s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:42 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4 Apr 28 05:59:42 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:43 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4" returned: 0 in 0.475s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:43 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4 is being set with open permissions: ugo+rw Apr 28 05:59:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:43 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4 Apr 28 05:59:43 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:43 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4" returned: 0 in 0.431s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:43 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:SELECT=63,cinder:INSERT=19,cinder:UPDATE=69,cinder:DELETE=5 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 05:59:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:43 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.info Apr 28 05:59:43 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:44 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.info" returned: 0 in 0.425s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:44 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.info is being set with open permissions: ugo+rw Apr 28 05:59:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:44 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.info Apr 28 05:59:44 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:44 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.info" returned: 0 in 0.423s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:44 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Acquiring lock "cinder-quobyte-cb8c043a-ca8e-497f-a5ac-ca61e631a539" by "_copy_volume_from_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:44 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Lock "cinder-quobyte-cb8c043a-ca8e-497f-a5ac-ca61e631a539" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] snapshot: 0effe51e-6284-4673-a7bf-7a96bed47be4, volume: cb8c043a-ca8e-497f-a5ac-ca61e631a539, {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 05:59:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:59:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:59:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:59:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:59:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:59:44 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c971d7b-ff7f-42a8-a101-d0aedbdd69af]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:44 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4 Apr 28 05:59:44 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:45 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4" returned: 0 in 0.502s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:45 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:59:45 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] will copy from snapshot at /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 05:59:45 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Creating direct copy from snapshot {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 05:59:45 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd851323-fd87-46ee-bfdc-2f940d6c5d4c]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:45 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c Apr 28 05:59:45 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:45 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c" returned: 0 in 0.499s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:45 devstack cinder-volume[81829]: DEBUG cinder.utils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Path /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cb8c043a-ca8e-497f-a5ac-ca61e631a539 not found in is_blk_device check {{(pid=81829) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 05:59:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cb8c043a-ca8e-497f-a5ac-ca61e631a539 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:45 devstack sudo[90756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cb8c043a-ca8e-497f-a5ac-ca61e631a539 Apr 28 05:59:45 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:49 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cb8c043a-ca8e-497f-a5ac-ca61e631a539" returned: 0 in 4.390s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:50 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[abebdd42-7e2e-4883-8190-c667945fa3e7]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:50 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c Apr 28 05:59:50 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:50 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c" returned: 0 in 0.652s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:50 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Image conversion details: src /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c, size 1024.00 MB, duration 4.39 sec, destination /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cb8c043a-ca8e-497f-a5ac-ca61e631a539 {{(pid=81829) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 05:59:50 devstack cinder-volume[81829]: INFO cinder.image.image_utils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Converted 1024.00 MB image at 233.19 MB/s Apr 28 05:59:50 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cb8c043a-ca8e-497f-a5ac-ca61e631a539 is being set with open permissions: ugo+rw Apr 28 05:59:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cb8c043a-ca8e-497f-a5ac-ca61e631a539 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:50 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cb8c043a-ca8e-497f-a5ac-ca61e631a539 Apr 28 05:59:50 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:51 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cb8c043a-ca8e-497f-a5ac-ca61e631a539" returned: 0 in 0.428s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:51 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Lock "cinder-quobyte-cb8c043a-ca8e-497f-a5ac-ca61e631a539" released by "_copy_volume_from_snapshot" :: held 6.551s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:51 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Acquiring lock "cinder-quobyte-0effe51e-6284-4673-a7bf-7a96bed47be4" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:51 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Lock "cinder-quobyte-0effe51e-6284-4673-a7bf-7a96bed47be4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Deleting offline snapshot 0effe51e-6284-4673-a7bf-7a96bed47be4 of volume 5d3bb53f-959a-47ea-ac06-951f98d13b1c {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 05:59:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] snapshot_file for this snap is: volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 05:59:51 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffd0a8a-3617-43cf-8f68-33f222d24d23]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:51 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4 Apr 28 05:59:51 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:51 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4" returned: 0 in 0.520s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 05:59:51 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f52ef7-e412-42cb-bbab-09a37f2d0b54]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:51 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c Apr 28 05:59:51 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:52 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c" returned: 0 in 0.520s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:52 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4 Apr 28 05:59:52 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:52 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4" returned: 0 in 0.545s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:52 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:52 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4 Apr 28 05:59:52 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:53 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c.0effe51e-6284-4673-a7bf-7a96bed47be4" returned: 0 in 0.424s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:53 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Lock "cinder-quobyte-0effe51e-6284-4673-a7bf-7a96bed47be4" released by "_delete_snapshot" :: held 2.101s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:53 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.685s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:59:53 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d5a4c0-c187-43be-b006-7b62adfabc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb8c043a-ca8e-497f-a5ac-ca61e631a539', 'volume_size': 1, 'source_volid': '5d3bb53f-959a-47ea-ac06-951f98d13b1c', 'source_volstatus': 'available'}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:53 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6a2955-5c07-40fa-b944-6ff191154cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 05:59:53 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Volume volume-cb8c043a-ca8e-497f-a5ac-ca61e631a539 (cb8c043a-ca8e-497f-a5ac-ca61e631a539): created successfully Apr 28 05:59:53 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6a2955-5c07-40fa-b944-6ff191154cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 05:59:53 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Flow 'volume_create_manager' (11a4d111-f1c8-4969-88d7-a0e1702babcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 05:59:53 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-675e2a86-0fe4-4b75-af42-c280f50d7ff2 tempest-VolumeDependencyTests-201346684 None] Created volume successfully. Apr 28 05:59:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-04775b6a-21fe-4b25-aa42-3e09c2b7541a tempest-VolumeDependencyTests-201346684 None] Acquiring lock "cinder-5d3bb53f-959a-47ea-ac06-951f98d13b1c-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-04775b6a-21fe-4b25-aa42-3e09c2b7541a tempest-VolumeDependencyTests-201346684 None] Lock "cinder-5d3bb53f-959a-47ea-ac06-951f98d13b1c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-04775b6a-21fe-4b25-aa42-3e09c2b7541a tempest-VolumeDependencyTests-201346684 None] Acquiring lock "cinder-quobyte-5d3bb53f-959a-47ea-ac06-951f98d13b1c" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:54 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-04775b6a-21fe-4b25-aa42-3e09c2b7541a tempest-VolumeDependencyTests-201346684 None] Lock "cinder-quobyte-5d3bb53f-959a-47ea-ac06-951f98d13b1c" acquired by "delete_volume" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:54 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccb3d80-05c8-40c8-ad1d-84dd28dbc28c]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:54 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-04775b6a-21fe-4b25-aa42-3e09c2b7541a tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:54 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c Apr 28 05:59:54 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:55 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-04775b6a-21fe-4b25-aa42-3e09c2b7541a tempest-VolumeDependencyTests-201346684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c" returned: 0 in 0.511s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-04775b6a-21fe-4b25-aa42-3e09c2b7541a tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:55 devstack sudo[90806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c Apr 28 05:59:55 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:55 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-04775b6a-21fe-4b25-aa42-3e09c2b7541a tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5d3bb53f-959a-47ea-ac06-951f98d13b1c" returned: 0 in 0.431s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:55 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-04775b6a-21fe-4b25-aa42-3e09c2b7541a tempest-VolumeDependencyTests-201346684 None] Lock "cinder-quobyte-5d3bb53f-959a-47ea-ac06-951f98d13b1c" released by "delete_volume" :: held 1.000s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:55 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-04775b6a-21fe-4b25-aa42-3e09c2b7541a tempest-VolumeDependencyTests-201346684 None] Created reservations ['0d233325-e024-48f3-930e-cb9a62b585f9', '28133f02-c56e-40df-a7f7-0f4b2e814cfe', 'f4f26bb2-4098-484d-ad32-4d67d454aec0', '82607fce-e623-4b97-a507-9dd2d1d5065f'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:59:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-04775b6a-21fe-4b25-aa42-3e09c2b7541a tempest-VolumeDependencyTests-201346684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:59:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-04775b6a-21fe-4b25-aa42-3e09c2b7541a tempest-VolumeDependencyTests-201346684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:59:55 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-04775b6a-21fe-4b25-aa42-3e09c2b7541a tempest-VolumeDependencyTests-201346684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:59:55 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-04775b6a-21fe-4b25-aa42-3e09c2b7541a tempest-VolumeDependencyTests-201346684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:59:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-04775b6a-21fe-4b25-aa42-3e09c2b7541a tempest-VolumeDependencyTests-201346684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:59:55 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-04775b6a-21fe-4b25-aa42-3e09c2b7541a tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:55 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:59:55 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:56 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-04775b6a-21fe-4b25-aa42-3e09c2b7541a tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.424s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:56 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-04775b6a-21fe-4b25-aa42-3e09c2b7541a tempest-VolumeDependencyTests-201346684 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:59:56 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-04775b6a-21fe-4b25-aa42-3e09c2b7541a tempest-VolumeDependencyTests-201346684 None] Deleted volume successfully. Apr 28 05:59:56 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-04775b6a-21fe-4b25-aa42-3e09c2b7541a tempest-VolumeDependencyTests-201346684 None] Lock "cinder-5d3bb53f-959a-47ea-ac06-951f98d13b1c-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:56 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6a0f662c-35c0-4d32-a31a-813b68d318a8 tempest-VolumeDependencyTests-201346684 None] Acquiring lock "cinder-cb8c043a-ca8e-497f-a5ac-ca61e631a539-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:56 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6a0f662c-35c0-4d32-a31a-813b68d318a8 tempest-VolumeDependencyTests-201346684 None] Lock "cinder-cb8c043a-ca8e-497f-a5ac-ca61e631a539-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:56 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6a0f662c-35c0-4d32-a31a-813b68d318a8 tempest-VolumeDependencyTests-201346684 None] Acquiring lock "cinder-quobyte-cb8c043a-ca8e-497f-a5ac-ca61e631a539" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:56 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6a0f662c-35c0-4d32-a31a-813b68d318a8 tempest-VolumeDependencyTests-201346684 None] Lock "cinder-quobyte-cb8c043a-ca8e-497f-a5ac-ca61e631a539" acquired by "delete_volume" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:56 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68f3795-66fa-479e-bf23-4fd5cdc436e9]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6a0f662c-35c0-4d32-a31a-813b68d318a8 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cb8c043a-ca8e-497f-a5ac-ca61e631a539 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:56 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cb8c043a-ca8e-497f-a5ac-ca61e631a539 Apr 28 05:59:56 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:57 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6a0f662c-35c0-4d32-a31a-813b68d318a8 tempest-VolumeDependencyTests-201346684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cb8c043a-ca8e-497f-a5ac-ca61e631a539" returned: 0 in 0.514s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6a0f662c-35c0-4d32-a31a-813b68d318a8 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cb8c043a-ca8e-497f-a5ac-ca61e631a539 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:57 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cb8c043a-ca8e-497f-a5ac-ca61e631a539 Apr 28 05:59:57 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:57 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6a0f662c-35c0-4d32-a31a-813b68d318a8 tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-cb8c043a-ca8e-497f-a5ac-ca61e631a539" returned: 0 in 0.426s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6a0f662c-35c0-4d32-a31a-813b68d318a8 tempest-VolumeDependencyTests-201346684 None] Lock "cinder-quobyte-cb8c043a-ca8e-497f-a5ac-ca61e631a539" released by "delete_volume" :: held 0.979s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:57 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-6a0f662c-35c0-4d32-a31a-813b68d318a8 tempest-VolumeDependencyTests-201346684 None] Created reservations ['81904a73-a9bd-4cd1-b528-34738d4f2ff7', '622b1a4d-01f1-4b8d-bdbc-6a6d12e25299', '41c7782a-aef3-468c-bd08-902b45dde439', 'fb48b453-8f1e-4913-adb1-17ace08d81b0'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 05:59:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6a0f662c-35c0-4d32-a31a-813b68d318a8 tempest-VolumeDependencyTests-201346684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 05:59:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6a0f662c-35c0-4d32-a31a-813b68d318a8 tempest-VolumeDependencyTests-201346684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 05:59:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6a0f662c-35c0-4d32-a31a-813b68d318a8 tempest-VolumeDependencyTests-201346684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 05:59:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-6a0f662c-35c0-4d32-a31a-813b68d318a8 tempest-VolumeDependencyTests-201346684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 05:59:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-6a0f662c-35c0-4d32-a31a-813b68d318a8 tempest-VolumeDependencyTests-201346684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 05:59:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6a0f662c-35c0-4d32-a31a-813b68d318a8 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:57 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 05:59:57 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:58 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6a0f662c-35c0-4d32-a31a-813b68d318a8 tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.440s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:58 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-6a0f662c-35c0-4d32-a31a-813b68d318a8 tempest-VolumeDependencyTests-201346684 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 05:59:58 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-6a0f662c-35c0-4d32-a31a-813b68d318a8 tempest-VolumeDependencyTests-201346684 None] Deleted volume successfully. Apr 28 05:59:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6a0f662c-35c0-4d32-a31a-813b68d318a8 tempest-VolumeDependencyTests-201346684 None] Lock "cinder-cb8c043a-ca8e-497f-a5ac-ca61e631a539-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 05:59:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7c619dc9-4685-4245-b335-431a3f4cea08 tempest-VolumeDependencyTests-201346684 None] Acquiring lock "cinder-b2891e99-0652-4835-b91c-71986ad9a203-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7c619dc9-4685-4245-b335-431a3f4cea08 tempest-VolumeDependencyTests-201346684 None] Lock "cinder-b2891e99-0652-4835-b91c-71986ad9a203-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7c619dc9-4685-4245-b335-431a3f4cea08 tempest-VolumeDependencyTests-201346684 None] Acquiring lock "cinder-quobyte-b2891e99-0652-4835-b91c-71986ad9a203" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 05:59:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7c619dc9-4685-4245-b335-431a3f4cea08 tempest-VolumeDependencyTests-201346684 None] Lock "cinder-quobyte-b2891e99-0652-4835-b91c-71986ad9a203" acquired by "delete_volume" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 05:59:59 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[36709bee-17eb-4c81-911e-e81330e727ac]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 05:59:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7c619dc9-4685-4245-b335-431a3f4cea08 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b2891e99-0652-4835-b91c-71986ad9a203 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:59 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b2891e99-0652-4835-b91c-71986ad9a203 Apr 28 05:59:59 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:59 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7c619dc9-4685-4245-b335-431a3f4cea08 tempest-VolumeDependencyTests-201346684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b2891e99-0652-4835-b91c-71986ad9a203" returned: 0 in 0.538s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7c619dc9-4685-4245-b335-431a3f4cea08 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b2891e99-0652-4835-b91c-71986ad9a203 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 05:59:59 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b2891e99-0652-4835-b91c-71986ad9a203 Apr 28 05:59:59 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 05:59:59 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Apr 28 05:59:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7c619dc9-4685-4245-b335-431a3f4cea08 tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-b2891e99-0652-4835-b91c-71986ad9a203" returned: 0 in 0.424s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 05:59:59 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7c619dc9-4685-4245-b335-431a3f4cea08 tempest-VolumeDependencyTests-201346684 None] Lock "cinder-quobyte-b2891e99-0652-4835-b91c-71986ad9a203" released by "delete_volume" :: held 1.002s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:00 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-7c619dc9-4685-4245-b335-431a3f4cea08 tempest-VolumeDependencyTests-201346684 None] Created reservations ['192ed670-7a91-4694-bc0c-21ace4cf4638', '58abc73d-6c1d-4223-9d75-b55c5195ae7b', '1df2c94e-3b16-4034-81a0-fcd885f13841', 'caad07de-7536-4df8-962a-f3d441dd7c92'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:00:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7c619dc9-4685-4245-b335-431a3f4cea08 tempest-VolumeDependencyTests-201346684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7c619dc9-4685-4245-b335-431a3f4cea08 tempest-VolumeDependencyTests-201346684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:00 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7c619dc9-4685-4245-b335-431a3f4cea08 tempest-VolumeDependencyTests-201346684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:00 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7c619dc9-4685-4245-b335-431a3f4cea08 tempest-VolumeDependencyTests-201346684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7c619dc9-4685-4245-b335-431a3f4cea08 tempest-VolumeDependencyTests-201346684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7c619dc9-4685-4245-b335-431a3f4cea08 tempest-VolumeDependencyTests-201346684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:00 devstack sudo[90832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:00:00 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:00 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7c619dc9-4685-4245-b335-431a3f4cea08 tempest-VolumeDependencyTests-201346684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.438s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:00 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-7c619dc9-4685-4245-b335-431a3f4cea08 tempest-VolumeDependencyTests-201346684 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:00:00 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-7c619dc9-4685-4245-b335-431a3f4cea08 tempest-VolumeDependencyTests-201346684 None] Deleted volume successfully. Apr 28 06:00:00 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7c619dc9-4685-4245-b335-431a3f4cea08 tempest-VolumeDependencyTests-201346684 None] Lock "cinder-b2891e99-0652-4835-b91c-71986ad9a203-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:06 devstack cinder-volume[81829]: DEBUG oslo_service.periodic_task [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81829) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 06:00:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:06 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:00:06 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:07 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.486s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:07 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Flow 'volume_create_manager' (2086550d-83a0-4451-9930-0806fd042ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7078b4c-cf03-4f03-b286-8f3c9444b164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7078b4c-cf03-4f03-b286-8f3c9444b164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-776443494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e03845e-ef1a-4566-9160-53f17841803d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f789a2e8d697489d9bb0f4870f08c299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:10Z,use_quota=True,user_id='407c0a8b44cc46f28c3e65b716948721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf26c9b-82ae-4c00-9c2a-4cba536298f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf26c9b-82ae-4c00-9c2a-4cba536298f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76fe50a-5656-460c-be59-34d2cea97811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76fe50a-5656-460c-be59-34d2cea97811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e03845e-ef1a-4566-9160-53f17841803d', 'volume_name': 'volume-0e03845e-ef1a-4566-9160-53f17841803d', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79316c66-3ad8-4ab5-b810-53510108249f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79316c66-3ad8-4ab5-b810-53510108249f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43cbaec-a4ad-40f9-a1e1-631b5f393e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:09 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Volume 0e03845e-ef1a-4566-9160-53f17841803d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e03845e-ef1a-4566-9160-53f17841803d', 'volume_size': 1} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-776443494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e03845e-ef1a-4566-9160-53f17841803d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f789a2e8d697489d9bb0f4870f08c299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:10Z,use_quota=True,user_id='407c0a8b44cc46f28c3e65b716948721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Creating volume 0e03845e-ef1a-4566-9160-53f17841803d {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:00:09 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:09 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d 1073741824 Apr 28 06:00:09 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Flow 'volume_create_manager' (23eaa899-a6c6-4e3b-9593-5e2dea71ceb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa613b1d-7796-403b-aa9f-74a1398686d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa613b1d-7796-403b-aa9f-74a1398686d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-701674609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ccfe318-ea6b-40e2-b5de-c84354b1f329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a994f26f2c14b98bc8c9c9f2b258af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:10Z,use_quota=True,user_id='868f722bb6594b6f8e40331c3721e681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09f8a64-6de1-436d-b47c-48d15918bab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09f8a64-6de1-436d-b47c-48d15918bab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f2957f-406a-4f30-aca7-bfad3a9cea4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f2957f-406a-4f30-aca7-bfad3a9cea4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ccfe318-ea6b-40e2-b5de-c84354b1f329', 'volume_name': 'volume-5ccfe318-ea6b-40e2-b5de-c84354b1f329', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320eae61-94a6-411d-a0f4-3209cf53079e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320eae61-94a6-411d-a0f4-3209cf53079e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5e21b5-800c-4050-a794-9ac33a400b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:09 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Volume 5ccfe318-ea6b-40e2-b5de-c84354b1f329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ccfe318-ea6b-40e2-b5de-c84354b1f329', 'volume_size': 1} Apr 28 06:00:09 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Flow 'volume_create_manager' (103f4490-400c-4d37-8a8c-80b0344f43f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fceb6bbe-ce6c-4d8f-bd7e-45aad6e4d8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fceb6bbe-ce6c-4d8f-bd7e-45aad6e4d8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-879899604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a0ceab-d38a-4512-b534-283333fc5a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eb839048a554322808686e6691bd7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:10Z,use_quota=True,user_id='4e08d91cef6642cbab55bd605ebc777b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af6c6b0-e039-4c81-b2da-884f8529a81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af6c6b0-e039-4c81-b2da-884f8529a81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c59fa43-1e42-4e59-9c2a-b91424bd7283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c59fa43-1e42-4e59-9c2a-b91424bd7283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94a0ceab-d38a-4512-b534-283333fc5a26', 'volume_name': 'volume-94a0ceab-d38a-4512-b534-283333fc5a26', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24802214-843e-4a3a-bcc1-888182012c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24802214-843e-4a3a-bcc1-888182012c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbaea59-3d78-4a39-b311-436081013f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:10 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Volume 94a0ceab-d38a-4512-b534-283333fc5a26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94a0ceab-d38a-4512-b534-283333fc5a26', 'volume_size': 1} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Flow 'volume_create_manager' (0e7760d0-ed9e-461e-b36e-a741c651912e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1935cf48-d918-448b-af4b-2e94b8275498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1935cf48-d918-448b-af4b-2e94b8275498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-124774834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3834d974-f63a-4bec-8d86-c76b2941f474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a994f26f2c14b98bc8c9c9f2b258af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:10Z,use_quota=True,user_id='868f722bb6594b6f8e40331c3721e681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b80bda2-7b1c-40f2-ac6c-aaac8f9393c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b80bda2-7b1c-40f2-ac6c-aaac8f9393c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6e5608-e464-4d7e-920f-13405a0f4ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6e5608-e464-4d7e-920f-13405a0f4ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3834d974-f63a-4bec-8d86-c76b2941f474', 'volume_name': 'volume-3834d974-f63a-4bec-8d86-c76b2941f474', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c34c9d-5431-481b-a3b1-0aec05ce7ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c34c9d-5431-481b-a3b1-0aec05ce7ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398c414c-e2dc-40c0-8777-18c50582e4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:10 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Volume 3834d974-f63a-4bec-8d86-c76b2941f474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3834d974-f63a-4bec-8d86-c76b2941f474', 'volume_size': 1} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:10 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d 1073741824" returned: 0 in 0.901s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Flow 'volume_create_manager' (4d79db88-7eb2-4604-8f9f-ba9e3036c3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467fd599-b024-4ccf-b870-2f44f57ca452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467fd599-b024-4ccf-b870-2f44f57ca452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1991831108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c33621a-3488-417c-8d47-bb2d41682f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a994f26f2c14b98bc8c9c9f2b258af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:11Z,use_quota=True,user_id='868f722bb6594b6f8e40331c3721e681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2cf1c94-2578-41ca-aa83-8f353b0a1c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2cf1c94-2578-41ca-aa83-8f353b0a1c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c91cbb8-f28d-4abd-9f3f-12bc1ba7943e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c91cbb8-f28d-4abd-9f3f-12bc1ba7943e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c33621a-3488-417c-8d47-bb2d41682f43', 'volume_name': 'volume-9c33621a-3488-417c-8d47-bb2d41682f43', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c85195-0b9f-47ee-8272-57c7f714a378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c85195-0b9f-47ee-8272-57c7f714a378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fee173a6-ec6e-4392-b53b-f6ccd1e77732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:10 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Volume 9c33621a-3488-417c-8d47-bb2d41682f43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c33621a-3488-417c-8d47-bb2d41682f43', 'volume_size': 1} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:10 devstack sudo[90886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d Apr 28 06:00:10 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Flow 'volume_create_manager' (79fd308e-9edc-46af-9a71-7619e06c5cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acdb5d6e-08f4-4941-8d15-bcd2c0229da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acdb5d6e-08f4-4941-8d15-bcd2c0229da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-351838946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c5f790e-0ac6-4a42-9768-9ac7922926c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a994f26f2c14b98bc8c9c9f2b258af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:11Z,use_quota=True,user_id='868f722bb6594b6f8e40331c3721e681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7ef56b-7d90-4987-afbb-e9172aa42f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7ef56b-7d90-4987-afbb-e9172aa42f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ebff5d-0652-484e-add9-7ea43fd2dc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ebff5d-0652-484e-add9-7ea43fd2dc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c5f790e-0ac6-4a42-9768-9ac7922926c4', 'volume_name': 'volume-2c5f790e-0ac6-4a42-9768-9ac7922926c4', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:10 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697eb11d-bbb2-48c0-b3a6-703beaf6785e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697eb11d-bbb2-48c0-b3a6-703beaf6785e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10eb1d9c-7acb-4e75-ac8c-95fb4bd2ebcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:11 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Volume 2c5f790e-0ac6-4a42-9768-9ac7922926c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c5f790e-0ac6-4a42-9768-9ac7922926c4', 'volume_size': 1} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Flow 'volume_create_manager' (2291b4fc-f7d9-45f9-8cc3-195acab8c5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184f91ff-4e4b-4569-97c1-d028e011cb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:11 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184f91ff-4e4b-4569-97c1-d028e011cb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1503576284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c713cd8f-a482-42ab-b48c-35da574fcf78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a994f26f2c14b98bc8c9c9f2b258af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:11Z,use_quota=True,user_id='868f722bb6594b6f8e40331c3721e681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ac930d-7a14-47ee-ba5a-9cb6a25e3cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ac930d-7a14-47ee-ba5a-9cb6a25e3cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df859711-a907-4159-98e6-6064668fb738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df859711-a907-4159-98e6-6064668fb738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c713cd8f-a482-42ab-b48c-35da574fcf78', 'volume_name': 'volume-c713cd8f-a482-42ab-b48c-35da574fcf78', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c11055b-3c9d-4518-aa35-0913309673a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c11055b-3c9d-4518-aa35-0913309673a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aca70a5-5acc-4f58-acc1-a8265bc73d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:11 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Volume c713cd8f-a482-42ab-b48c-35da574fcf78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c713cd8f-a482-42ab-b48c-35da574fcf78', 'volume_size': 1} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d" returned: 0 in 0.712s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.400s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-701674609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ccfe318-ea6b-40e2-b5de-c84354b1f329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a994f26f2c14b98bc8c9c9f2b258af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:10Z,use_quota=True,user_id='868f722bb6594b6f8e40331c3721e681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Creating volume 5ccfe318-ea6b-40e2-b5de-c84354b1f329 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:00:11 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5ccfe318-ea6b-40e2-b5de-c84354b1f329 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43cbaec-a4ad-40f9-a1e1-631b5f393e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e03845e-ef1a-4566-9160-53f17841803d', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:11 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5ccfe318-ea6b-40e2-b5de-c84354b1f329 1073741824 Apr 28 06:00:11 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60f5480-6675-4424-9f5f-cdcbaad010a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:11 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Volume volume-0e03845e-ef1a-4566-9160-53f17841803d (0e03845e-ef1a-4566-9160-53f17841803d): created successfully Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60f5480-6675-4424-9f5f-cdcbaad010a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:11 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Flow 'volume_create_manager' (2086550d-83a0-4451-9930-0806fd042ac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:11 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-a6e111cc-3007-4d97-96a3-7ab2b4d88480 tempest-VolumeDependencyTests-41616770 None] Created volume successfully. Apr 28 06:00:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-06779265-5a5e-48c3-925e-6b5cfc796c02 tempest-VolumeDependencyTests-41616770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:12 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5ccfe318-ea6b-40e2-b5de-c84354b1f329 1073741824" returned: 0 in 0.802s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5ccfe318-ea6b-40e2-b5de-c84354b1f329 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:12 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5ccfe318-ea6b-40e2-b5de-c84354b1f329 Apr 28 06:00:12 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:12 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5ccfe318-ea6b-40e2-b5de-c84354b1f329" returned: 0 in 0.494s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:12 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 06:00:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.570s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:12 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-879899604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a0ceab-d38a-4512-b534-283333fc5a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eb839048a554322808686e6691bd7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:10Z,use_quota=True,user_id='4e08d91cef6642cbab55bd605ebc777b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 06:00:12 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Creating volume 94a0ceab-d38a-4512-b534-283333fc5a26 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 06:00:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:12 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:12 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:12 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:00:12 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 06:00:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-94a0ceab-d38a-4512-b534-283333fc5a26 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:12 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-94a0ceab-d38a-4512-b534-283333fc5a26 1073741824 Apr 28 06:00:12 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:12 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5e21b5-800c-4050-a794-9ac33a400b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ccfe318-ea6b-40e2-b5de-c84354b1f329', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:12 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07835e5e-e104-428e-9284-799cef05ac67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:12 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Volume volume-5ccfe318-ea6b-40e2-b5de-c84354b1f329 (5ccfe318-ea6b-40e2-b5de-c84354b1f329): created successfully Apr 28 06:00:12 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07835e5e-e104-428e-9284-799cef05ac67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:12 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Flow 'volume_create_manager' (23eaa899-a6c6-4e3b-9593-5e2dea71ceb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:12 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-16a4c406-e11d-4ea6-9688-5c6e0837a7f3 tempest-CreateVolumesFromImageTest-2035191204 None] Created volume successfully. Apr 28 06:00:13 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-94a0ceab-d38a-4512-b534-283333fc5a26 1073741824" returned: 0 in 0.774s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-94a0ceab-d38a-4512-b534-283333fc5a26 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:13 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-94a0ceab-d38a-4512-b534-283333fc5a26 Apr 28 06:00:13 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:14 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-94a0ceab-d38a-4512-b534-283333fc5a26" returned: 0 in 0.450s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.647s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-124774834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3834d974-f63a-4bec-8d86-c76b2941f474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a994f26f2c14b98bc8c9c9f2b258af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:10Z,use_quota=True,user_id='868f722bb6594b6f8e40331c3721e681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Creating volume 3834d974-f63a-4bec-8d86-c76b2941f474 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:00:14 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3834d974-f63a-4bec-8d86-c76b2941f474 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbaea59-3d78-4a39-b311-436081013f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94a0ceab-d38a-4512-b534-283333fc5a26', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5da26cb-661e-4b3b-841e-31b20324717a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:14 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3834d974-f63a-4bec-8d86-c76b2941f474 1073741824 Apr 28 06:00:14 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:14 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Volume volume-94a0ceab-d38a-4512-b534-283333fc5a26 (94a0ceab-d38a-4512-b534-283333fc5a26): created successfully Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5da26cb-661e-4b3b-841e-31b20324717a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Flow 'volume_create_manager' (103f4490-400c-4d37-8a8c-80b0344f43f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:14 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-f03c3174-abdc-4625-8b5a-ee832688de9a tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Created volume successfully. Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Flow 'volume_create_manager' (de6cdeb5-10d7-499e-9249-230c303ef020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a136ac1-5564-4d7c-b32f-f36f05fda858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a136ac1-5564-4d7c-b32f-f36f05fda858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1337428983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c98a28d-1ef0-4da4-8abf-38b0cb160bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eb839048a554322808686e6691bd7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:15Z,use_quota=True,user_id='4e08d91cef6642cbab55bd605ebc777b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:14 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17b73e9-f953-4d3c-a305-b78eeebb11b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17b73e9-f953-4d3c-a305-b78eeebb11b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1cefc0c-6803-4c4b-99da-524bbc1ec383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1cefc0c-6803-4c4b-99da-524bbc1ec383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c98a28d-1ef0-4da4-8abf-38b0cb160bce', 'volume_name': 'volume-4c98a28d-1ef0-4da4-8abf-38b0cb160bce', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7207c3-394a-46a3-bb82-0a5e1d9cacba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7207c3-394a-46a3-bb82-0a5e1d9cacba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945f977a-841b-40d5-a08b-43740037f068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:14 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Volume 4c98a28d-1ef0-4da4-8abf-38b0cb160bce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c98a28d-1ef0-4da4-8abf-38b0cb160bce', 'volume_size': 1} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3834d974-f63a-4bec-8d86-c76b2941f474 1073741824" returned: 0 in 0.927s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3834d974-f63a-4bec-8d86-c76b2941f474 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:15 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3834d974-f63a-4bec-8d86-c76b2941f474 Apr 28 06:00:15 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Flow 'volume_create_manager' (484423cc-fb41-4a63-b7e8-f362e6cd0bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77310b71-31a7-4921-8e94-d102382fa163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77310b71-31a7-4921-8e94-d102382fa163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-86614253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d385987-53a2-4113-9db3-d938f7f8fc50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eb839048a554322808686e6691bd7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:15Z,use_quota=True,user_id='4e08d91cef6642cbab55bd605ebc777b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51318957-f08f-462b-b7f6-99474dfa030a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51318957-f08f-462b-b7f6-99474dfa030a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72dbad5f-c226-49e1-8a4c-97ee60aac993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72dbad5f-c226-49e1-8a4c-97ee60aac993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d385987-53a2-4113-9db3-d938f7f8fc50', 'volume_name': 'volume-0d385987-53a2-4113-9db3-d938f7f8fc50', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79dbae2-3c15-45a5-bb3b-14b1e6e8f324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c79dbae2-3c15-45a5-bb3b-14b1e6e8f324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91274777-59bc-47ca-b839-321ca6cddd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:15 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Volume 0d385987-53a2-4113-9db3-d938f7f8fc50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d385987-53a2-4113-9db3-d938f7f8fc50', 'volume_size': 1} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Flow 'volume_create_manager' (03e9e0c6-ee49-48b8-a92c-92a248011e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e4a62b-2767-45e1-a5d5-fc303a56a48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e4a62b-2767-45e1-a5d5-fc303a56a48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-54452460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fdc4371-1790-438a-acaf-6168e812e5ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eb839048a554322808686e6691bd7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:15Z,use_quota=True,user_id='4e08d91cef6642cbab55bd605ebc777b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c004356-38cb-420f-9b1e-1903510a47c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c004356-38cb-420f-9b1e-1903510a47c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e667806-c425-4df6-9b4d-b3c698aab82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e667806-c425-4df6-9b4d-b3c698aab82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fdc4371-1790-438a-acaf-6168e812e5ed', 'volume_name': 'volume-6fdc4371-1790-438a-acaf-6168e812e5ed', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21944c5d-aecb-4a01-9fdb-000965ff3a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21944c5d-aecb-4a01-9fdb-000965ff3a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0b4eda-6052-463e-970b-d1f92df00d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:15 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Volume 6fdc4371-1790-438a-acaf-6168e812e5ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fdc4371-1790-438a-acaf-6168e812e5ed', 'volume_size': 1} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Flow 'volume_create_manager' (66a5f7bf-bff1-4fff-93a7-b7bb3f21714e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b66015d3-34a0-4d1e-992d-33d287d56507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b66015d3-34a0-4d1e-992d-33d287d56507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1927729381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15259987-3121-49fa-b6b7-f04701b8fedb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eb839048a554322808686e6691bd7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:16Z,use_quota=True,user_id='4e08d91cef6642cbab55bd605ebc777b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:15 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62764d4-48ac-461b-831c-a84029f0085d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62764d4-48ac-461b-831c-a84029f0085d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6bead28-d628-40c2-9648-2882f5170498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6bead28-d628-40c2-9648-2882f5170498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15259987-3121-49fa-b6b7-f04701b8fedb', 'volume_name': 'volume-15259987-3121-49fa-b6b7-f04701b8fedb', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2677e72-ad3a-4e04-b46b-1a93c96773b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2677e72-ad3a-4e04-b46b-1a93c96773b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b94834f-78ee-4e81-86b4-e5049ff62f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:15 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Volume 15259987-3121-49fa-b6b7-f04701b8fedb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15259987-3121-49fa-b6b7-f04701b8fedb', 'volume_size': 1} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3834d974-f63a-4bec-8d86-c76b2941f474" returned: 0 in 0.975s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.297s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1991831108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c33621a-3488-417c-8d47-bb2d41682f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a994f26f2c14b98bc8c9c9f2b258af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:11Z,use_quota=True,user_id='868f722bb6594b6f8e40331c3721e681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Creating volume 9c33621a-3488-417c-8d47-bb2d41682f43 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:00:15 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 06:00:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9c33621a-3488-417c-8d47-bb2d41682f43 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398c414c-e2dc-40c0-8777-18c50582e4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3834d974-f63a-4bec-8d86-c76b2941f474', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558c09a2-3724-4070-896b-5390675aceb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:16 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Volume volume-3834d974-f63a-4bec-8d86-c76b2941f474 (3834d974-f63a-4bec-8d86-c76b2941f474): created successfully Apr 28 06:00:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558c09a2-3724-4070-896b-5390675aceb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Flow 'volume_create_manager' (0e7760d0-ed9e-461e-b36e-a741c651912e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:16 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9c33621a-3488-417c-8d47-bb2d41682f43 1073741824 Apr 28 06:00:16 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:16 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-c89caa38-6f64-40bd-892d-0d8befd1b593 tempest-CreateVolumesFromImageTest-2035191204 None] Created volume successfully. Apr 28 06:00:16 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Flow 'volume_create_manager' (61939095-08f2-4cae-8148-e476b083aa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e829d69f-96f3-40a5-bafb-2ad6c0c6d410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e829d69f-96f3-40a5-bafb-2ad6c0c6d410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-476381269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddcdaad9-0d5e-49c7-af01-df1d812be96a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eb839048a554322808686e6691bd7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:16Z,use_quota=True,user_id='4e08d91cef6642cbab55bd605ebc777b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fe90f2-d20f-4412-a05c-10ba4c46a986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fe90f2-d20f-4412-a05c-10ba4c46a986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba9c8c22-e2ee-43a7-ad75-c1d2c35b34ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba9c8c22-e2ee-43a7-ad75-c1d2c35b34ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddcdaad9-0d5e-49c7-af01-df1d812be96a', 'volume_name': 'volume-ddcdaad9-0d5e-49c7-af01-df1d812be96a', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68919a23-2eef-4a95-9fb0-e208f46e9a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68919a23-2eef-4a95-9fb0-e208f46e9a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af7e819-d84b-4b1a-bca8-0b2acadca594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:16 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Volume ddcdaad9-0d5e-49c7-af01-df1d812be96a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddcdaad9-0d5e-49c7-af01-df1d812be96a', 'volume_size': 1} Apr 28 06:00:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:16 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9c33621a-3488-417c-8d47-bb2d41682f43 1073741824" returned: 0 in 0.800s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9c33621a-3488-417c-8d47-bb2d41682f43 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:16 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9c33621a-3488-417c-8d47-bb2d41682f43 Apr 28 06:00:16 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:17 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9c33621a-3488-417c-8d47-bb2d41682f43" returned: 0 in 0.539s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:17 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 06:00:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.357s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:17 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-351838946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c5f790e-0ac6-4a42-9768-9ac7922926c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a994f26f2c14b98bc8c9c9f2b258af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:11Z,use_quota=True,user_id='868f722bb6594b6f8e40331c3721e681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 06:00:17 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Creating volume 2c5f790e-0ac6-4a42-9768-9ac7922926c4 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 06:00:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:17 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:17 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:17 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:00:17 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 06:00:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2c5f790e-0ac6-4a42-9768-9ac7922926c4 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fee173a6-ec6e-4392-b53b-f6ccd1e77732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c33621a-3488-417c-8d47-bb2d41682f43', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:17 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2c5f790e-0ac6-4a42-9768-9ac7922926c4 1073741824 Apr 28 06:00:17 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4544b01-fe6f-4c20-b7c3-9cb3d736ef5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:17 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Volume volume-9c33621a-3488-417c-8d47-bb2d41682f43 (9c33621a-3488-417c-8d47-bb2d41682f43): created successfully Apr 28 06:00:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4544b01-fe6f-4c20-b7c3-9cb3d736ef5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Flow 'volume_create_manager' (4d79db88-7eb2-4604-8f9f-ba9e3036c3ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:17 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-a8c30a64-ed81-4e13-b6f2-825525f85db6 tempest-CreateVolumesFromImageTest-2035191204 None] Created volume successfully. Apr 28 06:00:18 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2c5f790e-0ac6-4a42-9768-9ac7922926c4 1073741824" returned: 0 in 0.691s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2c5f790e-0ac6-4a42-9768-9ac7922926c4 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:18 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2c5f790e-0ac6-4a42-9768-9ac7922926c4 Apr 28 06:00:18 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:18 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2c5f790e-0ac6-4a42-9768-9ac7922926c4" returned: 0 in 0.479s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 06:00:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.191s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1503576284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c713cd8f-a482-42ab-b48c-35da574fcf78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a994f26f2c14b98bc8c9c9f2b258af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:11Z,use_quota=True,user_id='868f722bb6594b6f8e40331c3721e681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 06:00:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Creating volume c713cd8f-a482-42ab-b48c-35da574fcf78 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 06:00:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:00:18 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 06:00:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c713cd8f-a482-42ab-b48c-35da574fcf78 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:18 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c713cd8f-a482-42ab-b48c-35da574fcf78 1073741824 Apr 28 06:00:18 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10eb1d9c-7acb-4e75-ac8c-95fb4bd2ebcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c5f790e-0ac6-4a42-9768-9ac7922926c4', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755e0119-5ff5-4059-91be-ce4fafcfb53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:18 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Volume volume-2c5f790e-0ac6-4a42-9768-9ac7922926c4 (2c5f790e-0ac6-4a42-9768-9ac7922926c4): created successfully Apr 28 06:00:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755e0119-5ff5-4059-91be-ce4fafcfb53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Flow 'volume_create_manager' (79fd308e-9edc-46af-9a71-7619e06c5cab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:18 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-e4eada82-3456-47cb-ba79-38e963ce7403 tempest-CreateVolumesFromImageTest-2035191204 None] Created volume successfully. Apr 28 06:00:19 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c713cd8f-a482-42ab-b48c-35da574fcf78 1073741824" returned: 0 in 0.667s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c713cd8f-a482-42ab-b48c-35da574fcf78 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:19 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c713cd8f-a482-42ab-b48c-35da574fcf78 Apr 28 06:00:19 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:19 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c713cd8f-a482-42ab-b48c-35da574fcf78" returned: 0 in 0.553s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:19 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 06:00:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-06779265-5a5e-48c3-925e-6b5cfc796c02 tempest-VolumeDependencyTests-41616770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.772s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:19 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-06779265-5a5e-48c3-925e-6b5cfc796c02 tempest-VolumeDependencyTests-41616770 None] Creating offline snapshot e23dad47-0e65-46c0-95f7-db07ca393703 of volume 0e03845e-ef1a-4566-9160-53f17841803d {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 06:00:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aca70a5-5acc-4f58-acc1-a8265bc73d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c713cd8f-a482-42ab-b48c-35da574fcf78', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83c34fe-7692-4411-a78e-648b992a662a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:19 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dae9dd-df69-4608-83ec-0068280eda82]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-06779265-5a5e-48c3-925e-6b5cfc796c02 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:19 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Volume volume-c713cd8f-a482-42ab-b48c-35da574fcf78 (c713cd8f-a482-42ab-b48c-35da574fcf78): created successfully Apr 28 06:00:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83c34fe-7692-4411-a78e-648b992a662a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Flow 'volume_create_manager' (2291b4fc-f7d9-45f9-8cc3-195acab8c5fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:19 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-f94e525d-8a7b-4b79-9de6-709d9c1c27e3 tempest-CreateVolumesFromImageTest-2035191204 None] Created volume successfully. Apr 28 06:00:19 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d Apr 28 06:00:19 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-87094f58-7984-4b5f-9218-cee478887a9d tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "cinder-c713cd8f-a482-42ab-b48c-35da574fcf78-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-87094f58-7984-4b5f-9218-cee478887a9d tempest-CreateVolumesFromImageTest-2035191204 None] Lock "cinder-c713cd8f-a482-42ab-b48c-35da574fcf78-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-87094f58-7984-4b5f-9218-cee478887a9d tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "cinder-quobyte-c713cd8f-a482-42ab-b48c-35da574fcf78" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-87094f58-7984-4b5f-9218-cee478887a9d tempest-CreateVolumesFromImageTest-2035191204 None] Lock "cinder-quobyte-c713cd8f-a482-42ab-b48c-35da574fcf78" acquired by "delete_volume" :: waited 0.019s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:20 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[534929b7-556c-482d-8a29-90db99745bd0]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-87094f58-7984-4b5f-9218-cee478887a9d tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c713cd8f-a482-42ab-b48c-35da574fcf78 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:20 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c713cd8f-a482-42ab-b48c-35da574fcf78 Apr 28 06:00:20 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:20 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-06779265-5a5e-48c3-925e-6b5cfc796c02 tempest-VolumeDependencyTests-41616770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d" returned: 0 in 0.672s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-06779265-5a5e-48c3-925e-6b5cfc796c02 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:20 devstack sudo[90945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703 1G Apr 28 06:00:20 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:21 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-87094f58-7984-4b5f-9218-cee478887a9d tempest-CreateVolumesFromImageTest-2035191204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c713cd8f-a482-42ab-b48c-35da574fcf78" returned: 0 in 0.640s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-87094f58-7984-4b5f-9218-cee478887a9d tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c713cd8f-a482-42ab-b48c-35da574fcf78 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:21 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c713cd8f-a482-42ab-b48c-35da574fcf78 Apr 28 06:00:21 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:21 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-06779265-5a5e-48c3-925e-6b5cfc796c02 tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703 1G" returned: 0 in 0.688s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-06779265-5a5e-48c3-925e-6b5cfc796c02 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e03845e-ef1a-4566-9160-53f17841803d -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:21 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e03845e-ef1a-4566-9160-53f17841803d -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703 Apr 28 06:00:21 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:21 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-87094f58-7984-4b5f-9218-cee478887a9d tempest-CreateVolumesFromImageTest-2035191204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-c713cd8f-a482-42ab-b48c-35da574fcf78" returned: 0 in 0.616s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-87094f58-7984-4b5f-9218-cee478887a9d tempest-CreateVolumesFromImageTest-2035191204 None] Lock "cinder-quobyte-c713cd8f-a482-42ab-b48c-35da574fcf78" released by "delete_volume" :: held 1.304s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:21 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-87094f58-7984-4b5f-9218-cee478887a9d tempest-CreateVolumesFromImageTest-2035191204 None] Created reservations ['be84c077-2323-4dcc-a5db-477cad58e08a', 'ac48fe7a-5aad-42ba-8bfc-3f18af4d81b6', '51fdaced-b52b-49b5-b25b-1ef3d5156e11', '4673722b-aa3e-48e1-8151-7a16b290b19c'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:00:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-87094f58-7984-4b5f-9218-cee478887a9d tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-87094f58-7984-4b5f-9218-cee478887a9d tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-87094f58-7984-4b5f-9218-cee478887a9d tempest-CreateVolumesFromImageTest-2035191204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-87094f58-7984-4b5f-9218-cee478887a9d tempest-CreateVolumesFromImageTest-2035191204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-87094f58-7984-4b5f-9218-cee478887a9d tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-87094f58-7984-4b5f-9218-cee478887a9d tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:21 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-06779265-5a5e-48c3-925e-6b5cfc796c02 tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e03845e-ef1a-4566-9160-53f17841803d -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703" returned: 0 in 0.607s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:21 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-06779265-5a5e-48c3-925e-6b5cfc796c02 tempest-VolumeDependencyTests-41616770 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703 is being set with open permissions: ugo+rw Apr 28 06:00:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-06779265-5a5e-48c3-925e-6b5cfc796c02 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:21 devstack sudo[90962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:00:21 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:21 devstack sudo[90963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703 Apr 28 06:00:21 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:22 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-87094f58-7984-4b5f-9218-cee478887a9d tempest-CreateVolumesFromImageTest-2035191204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.463s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:22 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-87094f58-7984-4b5f-9218-cee478887a9d tempest-CreateVolumesFromImageTest-2035191204 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:00:22 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-87094f58-7984-4b5f-9218-cee478887a9d tempest-CreateVolumesFromImageTest-2035191204 None] Deleted volume successfully. Apr 28 06:00:22 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:22 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-87094f58-7984-4b5f-9218-cee478887a9d tempest-CreateVolumesFromImageTest-2035191204 None] Lock "cinder-c713cd8f-a482-42ab-b48c-35da574fcf78-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-06779265-5a5e-48c3-925e-6b5cfc796c02 tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703" returned: 0 in 0.487s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-06779265-5a5e-48c3-925e-6b5cfc796c02 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:22 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.info Apr 28 06:00:22 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:22 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-448f3a49-9118-4a4c-ba23-c8a6bab8bd3d tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "cinder-2c5f790e-0ac6-4a42-9768-9ac7922926c4-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:22 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-448f3a49-9118-4a4c-ba23-c8a6bab8bd3d tempest-CreateVolumesFromImageTest-2035191204 None] Lock "cinder-2c5f790e-0ac6-4a42-9768-9ac7922926c4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:22 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-448f3a49-9118-4a4c-ba23-c8a6bab8bd3d tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "cinder-quobyte-2c5f790e-0ac6-4a42-9768-9ac7922926c4" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:22 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-448f3a49-9118-4a4c-ba23-c8a6bab8bd3d tempest-CreateVolumesFromImageTest-2035191204 None] Lock "cinder-quobyte-2c5f790e-0ac6-4a42-9768-9ac7922926c4" acquired by "delete_volume" :: waited 0.036s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:22 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ca33ac-f674-4d11-a6ce-6fec1347750e]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-448f3a49-9118-4a4c-ba23-c8a6bab8bd3d tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2c5f790e-0ac6-4a42-9768-9ac7922926c4 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:22 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2c5f790e-0ac6-4a42-9768-9ac7922926c4 Apr 28 06:00:22 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:22 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-06779265-5a5e-48c3-925e-6b5cfc796c02 tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.info" returned: 0 in 0.610s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:23 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-06779265-5a5e-48c3-925e-6b5cfc796c02 tempest-VolumeDependencyTests-41616770 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.info is being set with open permissions: ugo+rw Apr 28 06:00:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-06779265-5a5e-48c3-925e-6b5cfc796c02 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:23 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.info Apr 28 06:00:23 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:23 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-448f3a49-9118-4a4c-ba23-c8a6bab8bd3d tempest-CreateVolumesFromImageTest-2035191204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2c5f790e-0ac6-4a42-9768-9ac7922926c4" returned: 0 in 0.596s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-448f3a49-9118-4a4c-ba23-c8a6bab8bd3d tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2c5f790e-0ac6-4a42-9768-9ac7922926c4 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:23 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2c5f790e-0ac6-4a42-9768-9ac7922926c4 Apr 28 06:00:23 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:23 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-06779265-5a5e-48c3-925e-6b5cfc796c02 tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.info" returned: 0 in 0.507s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-06779265-5a5e-48c3-925e-6b5cfc796c02 tempest-VolumeDependencyTests-41616770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.666s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.579s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:23 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1337428983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c98a28d-1ef0-4da4-8abf-38b0cb160bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eb839048a554322808686e6691bd7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:15Z,use_quota=True,user_id='4e08d91cef6642cbab55bd605ebc777b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 06:00:23 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Creating volume 4c98a28d-1ef0-4da4-8abf-38b0cb160bce {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 06:00:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:23 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:23 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:23 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:00:23 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 06:00:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4c98a28d-1ef0-4da4-8abf-38b0cb160bce 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:23 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4c98a28d-1ef0-4da4-8abf-38b0cb160bce 1073741824 Apr 28 06:00:23 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:23 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-06779265-5a5e-48c3-925e-6b5cfc796c02 tempest-VolumeDependencyTests-41616770 None] Create snapshot completed successfully Apr 28 06:00:23 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-448f3a49-9118-4a4c-ba23-c8a6bab8bd3d tempest-CreateVolumesFromImageTest-2035191204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-2c5f790e-0ac6-4a42-9768-9ac7922926c4" returned: 0 in 0.597s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-448f3a49-9118-4a4c-ba23-c8a6bab8bd3d tempest-CreateVolumesFromImageTest-2035191204 None] Lock "cinder-quobyte-2c5f790e-0ac6-4a42-9768-9ac7922926c4" released by "delete_volume" :: held 1.248s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-448f3a49-9118-4a4c-ba23-c8a6bab8bd3d tempest-CreateVolumesFromImageTest-2035191204 None] Created reservations ['f63a9b58-00e0-4337-ab3a-638ddcc196d4', '3bb34823-e483-4aaf-9f7b-343b0986c4e9', '5f65a617-5e7f-4c46-a45d-2cebbfd5de25', 'd9fff179-3d64-4bda-9bbb-07e8fb857579'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-448f3a49-9118-4a4c-ba23-c8a6bab8bd3d tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-448f3a49-9118-4a4c-ba23-c8a6bab8bd3d tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-448f3a49-9118-4a4c-ba23-c8a6bab8bd3d tempest-CreateVolumesFromImageTest-2035191204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-448f3a49-9118-4a4c-ba23-c8a6bab8bd3d tempest-CreateVolumesFromImageTest-2035191204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-448f3a49-9118-4a4c-ba23-c8a6bab8bd3d tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-448f3a49-9118-4a4c-ba23-c8a6bab8bd3d tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:24 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:00:24 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:24 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4c98a28d-1ef0-4da4-8abf-38b0cb160bce 1073741824" returned: 0 in 0.778s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4c98a28d-1ef0-4da4-8abf-38b0cb160bce {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:24 devstack sudo[91024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4c98a28d-1ef0-4da4-8abf-38b0cb160bce Apr 28 06:00:24 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:24 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-448f3a49-9118-4a4c-ba23-c8a6bab8bd3d tempest-CreateVolumesFromImageTest-2035191204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.551s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-448f3a49-9118-4a4c-ba23-c8a6bab8bd3d tempest-CreateVolumesFromImageTest-2035191204 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:00:24 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-448f3a49-9118-4a4c-ba23-c8a6bab8bd3d tempest-CreateVolumesFromImageTest-2035191204 None] Deleted volume successfully. Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-448f3a49-9118-4a4c-ba23-c8a6bab8bd3d tempest-CreateVolumesFromImageTest-2035191204 None] Lock "cinder-2c5f790e-0ac6-4a42-9768-9ac7922926c4-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:24 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4c98a28d-1ef0-4da4-8abf-38b0cb160bce" returned: 0 in 0.573s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.695s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-86614253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d385987-53a2-4113-9db3-d938f7f8fc50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eb839048a554322808686e6691bd7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:15Z,use_quota=True,user_id='4e08d91cef6642cbab55bd605ebc777b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Creating volume 0d385987-53a2-4113-9db3-d938f7f8fc50 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:00:24 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 06:00:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0d385987-53a2-4113-9db3-d938f7f8fc50 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945f977a-841b-40d5-a08b-43740037f068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c98a28d-1ef0-4da4-8abf-38b0cb160bce', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:25 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0d385987-53a2-4113-9db3-d938f7f8fc50 1073741824 Apr 28 06:00:25 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671c5a39-e7eb-43d0-b4e8-eac6e80fb134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-48de4adc-8ff6-488f-8841-af367326da3b tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "cinder-9c33621a-3488-417c-8d47-bb2d41682f43-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:25 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Volume volume-4c98a28d-1ef0-4da4-8abf-38b0cb160bce (4c98a28d-1ef0-4da4-8abf-38b0cb160bce): created successfully Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671c5a39-e7eb-43d0-b4e8-eac6e80fb134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Flow 'volume_create_manager' (de6cdeb5-10d7-499e-9249-230c303ef020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-48de4adc-8ff6-488f-8841-af367326da3b tempest-CreateVolumesFromImageTest-2035191204 None] Lock "cinder-9c33621a-3488-417c-8d47-bb2d41682f43-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:25 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-2ad4703b-f544-439b-95d0-d5ba7ef70c48 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Created volume successfully. Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Flow 'volume_create_manager' (7f41f261-568f-40de-82c6-de6e3cddd0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493e8eba-79a4-4796-8fa0-1519a4e749ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (493e8eba-79a4-4796-8fa0-1519a4e749ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-411521997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f57a65b-9b19-4157-8f57-986827a37b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f789a2e8d697489d9bb0f4870f08c299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e23dad47-0e65-46c0-95f7-db07ca393703,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:25Z,use_quota=True,user_id='407c0a8b44cc46f28c3e65b716948721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f79b5f-d62d-4674-a873-1f6d55f0516d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f79b5f-d62d-4674-a873-1f6d55f0516d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53d6357-0329-43de-9f0f-8f75e51197f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53d6357-0329-43de-9f0f-8f75e51197f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3f57a65b-9b19-4157-8f57-986827a37b96', 'volume_name': 'volume-3f57a65b-9b19-4157-8f57-986827a37b96', 'volume_size': 1, 'snapshot_id': 'e23dad47-0e65-46c0-95f7-db07ca393703'}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb0e2e20-a792-4fa2-9330-59fc3ccd1f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb0e2e20-a792-4fa2-9330-59fc3ccd1f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de17f5ac-b8d6-4ec6-8043-5ce0cb456fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:25 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Volume 3f57a65b-9b19-4157-8f57-986827a37b96: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3f57a65b-9b19-4157-8f57-986827a37b96', 'volume_size': 1, 'snapshot_id': 'e23dad47-0e65-46c0-95f7-db07ca393703'} Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-48de4adc-8ff6-488f-8841-af367326da3b tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "cinder-quobyte-9c33621a-3488-417c-8d47-bb2d41682f43" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-48de4adc-8ff6-488f-8841-af367326da3b tempest-CreateVolumesFromImageTest-2035191204 None] Lock "cinder-quobyte-9c33621a-3488-417c-8d47-bb2d41682f43" acquired by "delete_volume" :: waited 0.022s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c12049-571e-40f6-b459-e718c4167d57]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-48de4adc-8ff6-488f-8841-af367326da3b tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9c33621a-3488-417c-8d47-bb2d41682f43 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:25 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9c33621a-3488-417c-8d47-bb2d41682f43 Apr 28 06:00:25 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:25 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0d385987-53a2-4113-9db3-d938f7f8fc50 1073741824" returned: 0 in 0.879s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0d385987-53a2-4113-9db3-d938f7f8fc50 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:25 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0d385987-53a2-4113-9db3-d938f7f8fc50 Apr 28 06:00:25 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:26 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-48de4adc-8ff6-488f-8841-af367326da3b tempest-CreateVolumesFromImageTest-2035191204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9c33621a-3488-417c-8d47-bb2d41682f43" returned: 0 in 0.697s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-48de4adc-8ff6-488f-8841-af367326da3b tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9c33621a-3488-417c-8d47-bb2d41682f43 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:26 devstack sudo[91040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9c33621a-3488-417c-8d47-bb2d41682f43 Apr 28 06:00:26 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:26 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0d385987-53a2-4113-9db3-d938f7f8fc50" returned: 0 in 0.595s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.762s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-54452460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fdc4371-1790-438a-acaf-6168e812e5ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eb839048a554322808686e6691bd7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:15Z,use_quota=True,user_id='4e08d91cef6642cbab55bd605ebc777b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Creating volume 6fdc4371-1790-438a-acaf-6168e812e5ed {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:00:26 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6fdc4371-1790-438a-acaf-6168e812e5ed 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91274777-59bc-47ca-b839-321ca6cddd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d385987-53a2-4113-9db3-d938f7f8fc50', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8836934-09a0-47fe-924e-09c5d719712b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:26 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6fdc4371-1790-438a-acaf-6168e812e5ed 1073741824 Apr 28 06:00:26 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:26 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Volume volume-0d385987-53a2-4113-9db3-d938f7f8fc50 (0d385987-53a2-4113-9db3-d938f7f8fc50): created successfully Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8836934-09a0-47fe-924e-09c5d719712b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Flow 'volume_create_manager' (484423cc-fb41-4a63-b7e8-f362e6cd0bb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:26 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-cf4dbd36-4020-4a0d-83ee-bedf34814b5c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Created volume successfully. Apr 28 06:00:26 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-48de4adc-8ff6-488f-8841-af367326da3b tempest-CreateVolumesFromImageTest-2035191204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-9c33621a-3488-417c-8d47-bb2d41682f43" returned: 0 in 0.631s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-48de4adc-8ff6-488f-8841-af367326da3b tempest-CreateVolumesFromImageTest-2035191204 None] Lock "cinder-quobyte-9c33621a-3488-417c-8d47-bb2d41682f43" released by "delete_volume" :: held 1.385s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-48de4adc-8ff6-488f-8841-af367326da3b tempest-CreateVolumesFromImageTest-2035191204 None] Created reservations ['b3e54590-bd9b-4688-850e-98ba560c1a59', '2f8a6b10-5352-4671-bb4a-3e68cb9f6bb3', '75ecbae4-f8f4-4c78-880d-d103e2240a92', 'f793a9ed-08a7-45f9-b132-e68a4c925ea8'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-48de4adc-8ff6-488f-8841-af367326da3b tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-48de4adc-8ff6-488f-8841-af367326da3b tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-48de4adc-8ff6-488f-8841-af367326da3b tempest-CreateVolumesFromImageTest-2035191204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-48de4adc-8ff6-488f-8841-af367326da3b tempest-CreateVolumesFromImageTest-2035191204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-48de4adc-8ff6-488f-8841-af367326da3b tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-48de4adc-8ff6-488f-8841-af367326da3b tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:26 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:00:26 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-77533c87-0350-4774-9f2d-af04732c4b4d tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "cinder-3834d974-f63a-4bec-8d86-c76b2941f474-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-77533c87-0350-4774-9f2d-af04732c4b4d tempest-CreateVolumesFromImageTest-2035191204 None] Lock "cinder-3834d974-f63a-4bec-8d86-c76b2941f474-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-77533c87-0350-4774-9f2d-af04732c4b4d tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "cinder-quobyte-3834d974-f63a-4bec-8d86-c76b2941f474" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-77533c87-0350-4774-9f2d-af04732c4b4d tempest-CreateVolumesFromImageTest-2035191204 None] Lock "cinder-quobyte-3834d974-f63a-4bec-8d86-c76b2941f474" acquired by "delete_volume" :: waited 0.023s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:27 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2ac1b3-067b-4598-b5d1-68efa701f0f6]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-77533c87-0350-4774-9f2d-af04732c4b4d tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3834d974-f63a-4bec-8d86-c76b2941f474 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:27 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-48de4adc-8ff6-488f-8841-af367326da3b tempest-CreateVolumesFromImageTest-2035191204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.651s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:27 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-48de4adc-8ff6-488f-8841-af367326da3b tempest-CreateVolumesFromImageTest-2035191204 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:00:27 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-48de4adc-8ff6-488f-8841-af367326da3b tempest-CreateVolumesFromImageTest-2035191204 None] Deleted volume successfully. Apr 28 06:00:27 devstack sudo[91052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3834d974-f63a-4bec-8d86-c76b2941f474 Apr 28 06:00:27 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-48de4adc-8ff6-488f-8841-af367326da3b tempest-CreateVolumesFromImageTest-2035191204 None] Lock "cinder-9c33621a-3488-417c-8d47-bb2d41682f43-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:27 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6fdc4371-1790-438a-acaf-6168e812e5ed 1073741824" returned: 0 in 1.062s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6fdc4371-1790-438a-acaf-6168e812e5ed {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:27 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6fdc4371-1790-438a-acaf-6168e812e5ed Apr 28 06:00:27 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:28 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-77533c87-0350-4774-9f2d-af04732c4b4d tempest-CreateVolumesFromImageTest-2035191204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3834d974-f63a-4bec-8d86-c76b2941f474" returned: 0 in 0.655s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-77533c87-0350-4774-9f2d-af04732c4b4d tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3834d974-f63a-4bec-8d86-c76b2941f474 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:28 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3834d974-f63a-4bec-8d86-c76b2941f474 Apr 28 06:00:28 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:28 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6fdc4371-1790-438a-acaf-6168e812e5ed" returned: 0 in 0.579s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.234s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1927729381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15259987-3121-49fa-b6b7-f04701b8fedb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eb839048a554322808686e6691bd7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:16Z,use_quota=True,user_id='4e08d91cef6642cbab55bd605ebc777b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Creating volume 15259987-3121-49fa-b6b7-f04701b8fedb {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:00:28 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-15259987-3121-49fa-b6b7-f04701b8fedb 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0b4eda-6052-463e-970b-d1f92df00d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fdc4371-1790-438a-acaf-6168e812e5ed', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff812a6-a729-4e50-99cd-4514b3011c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:28 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-15259987-3121-49fa-b6b7-f04701b8fedb 1073741824 Apr 28 06:00:28 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:28 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Volume volume-6fdc4371-1790-438a-acaf-6168e812e5ed (6fdc4371-1790-438a-acaf-6168e812e5ed): created successfully Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff812a6-a729-4e50-99cd-4514b3011c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Flow 'volume_create_manager' (03e9e0c6-ee49-48b8-a92c-92a248011e05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:28 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-103f559e-ac39-4a7a-a8eb-aaf083b81d1f tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Created volume successfully. Apr 28 06:00:28 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-77533c87-0350-4774-9f2d-af04732c4b4d tempest-CreateVolumesFromImageTest-2035191204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3834d974-f63a-4bec-8d86-c76b2941f474" returned: 0 in 0.519s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-77533c87-0350-4774-9f2d-af04732c4b4d tempest-CreateVolumesFromImageTest-2035191204 None] Lock "cinder-quobyte-3834d974-f63a-4bec-8d86-c76b2941f474" released by "delete_volume" :: held 1.217s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-77533c87-0350-4774-9f2d-af04732c4b4d tempest-CreateVolumesFromImageTest-2035191204 None] Created reservations ['b3a21e01-7eb9-4dea-93bc-db08a52762af', 'bda62863-893b-4720-8544-195607b6ee05', '7f51b023-e712-4862-a133-1b4eda88b1d1', 'ba2c97e5-991a-4e87-8816-28a6627f7daa'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-77533c87-0350-4774-9f2d-af04732c4b4d tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-77533c87-0350-4774-9f2d-af04732c4b4d tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-77533c87-0350-4774-9f2d-af04732c4b4d tempest-CreateVolumesFromImageTest-2035191204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-77533c87-0350-4774-9f2d-af04732c4b4d tempest-CreateVolumesFromImageTest-2035191204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-77533c87-0350-4774-9f2d-af04732c4b4d tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-77533c87-0350-4774-9f2d-af04732c4b4d tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:28 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:00:28 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:29 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-15259987-3121-49fa-b6b7-f04701b8fedb 1073741824" returned: 0 in 0.852s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-15259987-3121-49fa-b6b7-f04701b8fedb {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:29 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-15259987-3121-49fa-b6b7-f04701b8fedb Apr 28 06:00:29 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:29 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-77533c87-0350-4774-9f2d-af04732c4b4d tempest-CreateVolumesFromImageTest-2035191204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.640s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-77533c87-0350-4774-9f2d-af04732c4b4d tempest-CreateVolumesFromImageTest-2035191204 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:00:29 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-77533c87-0350-4774-9f2d-af04732c4b4d tempest-CreateVolumesFromImageTest-2035191204 None] Deleted volume successfully. Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-77533c87-0350-4774-9f2d-af04732c4b4d tempest-CreateVolumesFromImageTest-2035191204 None] Lock "cinder-3834d974-f63a-4bec-8d86-c76b2941f474-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b6cb730c-18a5-44b8-8a79-c557ed31a9d6 tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "cinder-5ccfe318-ea6b-40e2-b5de-c84354b1f329-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b6cb730c-18a5-44b8-8a79-c557ed31a9d6 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "cinder-5ccfe318-ea6b-40e2-b5de-c84354b1f329-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b6cb730c-18a5-44b8-8a79-c557ed31a9d6 tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "cinder-quobyte-5ccfe318-ea6b-40e2-b5de-c84354b1f329" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b6cb730c-18a5-44b8-8a79-c557ed31a9d6 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "cinder-quobyte-5ccfe318-ea6b-40e2-b5de-c84354b1f329" acquired by "delete_volume" :: waited 0.025s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:29 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-15259987-3121-49fa-b6b7-f04701b8fedb" returned: 0 in 0.664s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.466s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-476381269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddcdaad9-0d5e-49c7-af01-df1d812be96a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eb839048a554322808686e6691bd7db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:16Z,use_quota=True,user_id='4e08d91cef6642cbab55bd605ebc777b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Creating volume ddcdaad9-0d5e-49c7-af01-df1d812be96a {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:00:29 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ddcdaad9-0d5e-49c7-af01-df1d812be96a 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa55f447-886a-4124-8a95-3c94816c6eca]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b6cb730c-18a5-44b8-8a79-c557ed31a9d6 tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5ccfe318-ea6b-40e2-b5de-c84354b1f329 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:29 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ddcdaad9-0d5e-49c7-af01-df1d812be96a 1073741824 Apr 28 06:00:29 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b94834f-78ee-4e81-86b4-e5049ff62f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15259987-3121-49fa-b6b7-f04701b8fedb', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30cd9cbc-89b1-4591-8e6a-413a32035bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Flow 'volume_create_manager' (85bd8fc2-381b-465f-a457-39983eac4d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9136f619-aa52-49f6-9520-eb2d47d8adb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:29 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5ccfe318-ea6b-40e2-b5de-c84354b1f329 Apr 28 06:00:29 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:29 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Volume volume-15259987-3121-49fa-b6b7-f04701b8fedb (15259987-3121-49fa-b6b7-f04701b8fedb): created successfully Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30cd9cbc-89b1-4591-8e6a-413a32035bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Flow 'volume_create_manager' (66a5f7bf-bff1-4fff-93a7-b7bb3f21714e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9136f619-aa52-49f6-9520-eb2d47d8adb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-760930035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143796a1-9c7a-41c3-b0cd-6d105274b974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa648f5fe6844e19e937aa31649bef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:30Z,use_quota=True,user_id='ab63b2c0af344ba4ab9c9ed4e6c48ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (149c923e-a60d-4af1-af4d-1b5c14d32c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (149c923e-a60d-4af1-af4d-1b5c14d32c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91cc3453-dc1f-42c5-830b-fdc8a3792647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91cc3453-dc1f-42c5-830b-fdc8a3792647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '143796a1-9c7a-41c3-b0cd-6d105274b974', 'volume_name': 'volume-143796a1-9c7a-41c3-b0cd-6d105274b974', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e965f26-3a51-46b3-9858-5bb3ec06eab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e965f26-3a51-46b3-9858-5bb3ec06eab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba35d0d1-0773-4c63-960b-56c90da8e56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:29 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Volume 143796a1-9c7a-41c3-b0cd-6d105274b974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-143796a1-9c7a-41c3-b0cd-6d105274b974', 'volume_size': 1} Apr 28 06:00:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:29 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-80bb6e4d-6925-4cb3-b456-47d9d4a81953 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Created volume successfully. Apr 28 06:00:30 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b6cb730c-18a5-44b8-8a79-c557ed31a9d6 tempest-CreateVolumesFromImageTest-2035191204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5ccfe318-ea6b-40e2-b5de-c84354b1f329" returned: 0 in 0.583s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b6cb730c-18a5-44b8-8a79-c557ed31a9d6 tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5ccfe318-ea6b-40e2-b5de-c84354b1f329 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:30 devstack sudo[91084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5ccfe318-ea6b-40e2-b5de-c84354b1f329 Apr 28 06:00:30 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:30 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ddcdaad9-0d5e-49c7-af01-df1d812be96a 1073741824" returned: 0 in 0.671s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ddcdaad9-0d5e-49c7-af01-df1d812be96a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:30 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ddcdaad9-0d5e-49c7-af01-df1d812be96a Apr 28 06:00:30 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:30 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b6cb730c-18a5-44b8-8a79-c557ed31a9d6 tempest-CreateVolumesFromImageTest-2035191204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-5ccfe318-ea6b-40e2-b5de-c84354b1f329" returned: 0 in 0.465s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b6cb730c-18a5-44b8-8a79-c557ed31a9d6 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "cinder-quobyte-5ccfe318-ea6b-40e2-b5de-c84354b1f329" released by "delete_volume" :: held 1.135s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:30 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ddcdaad9-0d5e-49c7-af01-df1d812be96a" returned: 0 in 0.433s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.559s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Acquiring lock "cinder-quobyte-e23dad47-0e65-46c0-95f7-db07ca393703-3f57a65b-9b19-4157-8f57-986827a37b96" by "_create_volume_from_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-b6cb730c-18a5-44b8-8a79-c557ed31a9d6 tempest-CreateVolumesFromImageTest-2035191204 None] Created reservations ['5e79aa23-78e9-4e00-8eaa-6f6262227ad6', 'bac4a52f-144f-4d00-b7a2-f69995a5605b', 'c48f75c9-9f29-4317-9e0d-d74323294b4c', '0e7e14d2-76b2-43b4-bcfb-c1b20eb1f78d'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af7e819-d84b-4b1a-bca8-0b2acadca594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddcdaad9-0d5e-49c7-af01-df1d812be96a', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67be7bb-c59f-45e1-9bb5-2c221f0bf75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Lock "cinder-quobyte-e23dad47-0e65-46c0-95f7-db07ca393703-3f57a65b-9b19-4157-8f57-986827a37b96" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Creating volume 3f57a65b-9b19-4157-8f57-986827a37b96 from snapshot e23dad47-0e65-46c0-95f7-db07ca393703 {{(pid=81829) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Acquiring lock "cinder-quobyte-3f57a65b-9b19-4157-8f57-986827a37b96" by "_copy_volume_from_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:30 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Volume volume-ddcdaad9-0d5e-49c7-af01-df1d812be96a (ddcdaad9-0d5e-49c7-af01-df1d812be96a): created successfully Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67be7bb-c59f-45e1-9bb5-2c221f0bf75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Flow 'volume_create_manager' (61939095-08f2-4cae-8148-e476b083aa58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Lock "cinder-quobyte-3f57a65b-9b19-4157-8f57-986827a37b96" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] snapshot: e23dad47-0e65-46c0-95f7-db07ca393703, volume: 3f57a65b-9b19-4157-8f57-986827a37b96, {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 06:00:31 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-1126a989-d573-4f7d-ab20-7210bffbf586 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Created volume successfully. Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[266941c4-17b1-48dc-8cf8-69a9b7688a63]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b6cb730c-18a5-44b8-8a79-c557ed31a9d6 tempest-CreateVolumesFromImageTest-2035191204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b6cb730c-18a5-44b8-8a79-c557ed31a9d6 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b6cb730c-18a5-44b8-8a79-c557ed31a9d6 tempest-CreateVolumesFromImageTest-2035191204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b6cb730c-18a5-44b8-8a79-c557ed31a9d6 tempest-CreateVolumesFromImageTest-2035191204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b6cb730c-18a5-44b8-8a79-c557ed31a9d6 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b6cb730c-18a5-44b8-8a79-c557ed31a9d6 tempest-CreateVolumesFromImageTest-2035191204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:31 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:00:31 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:31 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703 Apr 28 06:00:31 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:31 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b6cb730c-18a5-44b8-8a79-c557ed31a9d6 tempest-CreateVolumesFromImageTest-2035191204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.469s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-b6cb730c-18a5-44b8-8a79-c557ed31a9d6 tempest-CreateVolumesFromImageTest-2035191204 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:00:31 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-b6cb730c-18a5-44b8-8a79-c557ed31a9d6 tempest-CreateVolumesFromImageTest-2035191204 None] Deleted volume successfully. Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b6cb730c-18a5-44b8-8a79-c557ed31a9d6 tempest-CreateVolumesFromImageTest-2035191204 None] Lock "cinder-5ccfe318-ea6b-40e2-b5de-c84354b1f329-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5cf5d422-6536-4480-9a56-b2075c14f9fd tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "cinder-ddcdaad9-0d5e-49c7-af01-df1d812be96a-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5cf5d422-6536-4480-9a56-b2075c14f9fd tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-ddcdaad9-0d5e-49c7-af01-df1d812be96a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:31 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5cf5d422-6536-4480-9a56-b2075c14f9fd tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "cinder-quobyte-ddcdaad9-0d5e-49c7-af01-df1d812be96a" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703" returned: 0 in 0.603s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e03845e-ef1a-4566-9160-53f17841803d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] will copy from snapshot at /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Creating direct copy from snapshot {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5cf5d422-6536-4480-9a56-b2075c14f9fd tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-quobyte-ddcdaad9-0d5e-49c7-af01-df1d812be96a" acquired by "delete_volume" :: waited 0.025s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e6380b-869e-4ee3-949e-8ee600ced5d1]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e96d48-a541-4fb1-b982-6b0aab6082c8]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5cf5d422-6536-4480-9a56-b2075c14f9fd tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ddcdaad9-0d5e-49c7-af01-df1d812be96a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:31 devstack sudo[91099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d Apr 28 06:00:31 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:31 devstack sudo[91100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ddcdaad9-0d5e-49c7-af01-df1d812be96a Apr 28 06:00:31 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:32 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d" returned: 0 in 0.607s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:32 devstack cinder-volume[81829]: DEBUG cinder.utils [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Path /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f57a65b-9b19-4157-8f57-986827a37b96 not found in is_blk_device check {{(pid=81829) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 06:00:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f57a65b-9b19-4157-8f57-986827a37b96 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:32 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5cf5d422-6536-4480-9a56-b2075c14f9fd tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ddcdaad9-0d5e-49c7-af01-df1d812be96a" returned: 0 in 0.625s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5cf5d422-6536-4480-9a56-b2075c14f9fd tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ddcdaad9-0d5e-49c7-af01-df1d812be96a {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:32 devstack sudo[91109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f57a65b-9b19-4157-8f57-986827a37b96 Apr 28 06:00:32 devstack sudo[91109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:32 devstack sudo[91110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ddcdaad9-0d5e-49c7-af01-df1d812be96a Apr 28 06:00:32 devstack sudo[91110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:32 devstack sudo[91110]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5cf5d422-6536-4480-9a56-b2075c14f9fd tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-ddcdaad9-0d5e-49c7-af01-df1d812be96a" returned: 0 in 0.542s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:32 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5cf5d422-6536-4480-9a56-b2075c14f9fd tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-quobyte-ddcdaad9-0d5e-49c7-af01-df1d812be96a" released by "delete_volume" :: held 1.213s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:32 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-5cf5d422-6536-4480-9a56-b2075c14f9fd tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Created reservations ['a7e7892b-f587-4a9a-974d-25e127aad97a', '8e29507c-5754-467a-8664-4c53d4199b09', 'a82507e0-4620-4890-8ffa-8d1836eec8c5', '14b27f77-54d8-4bfa-bcb8-2e31a1ee9417'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:00:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5cf5d422-6536-4480-9a56-b2075c14f9fd tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5cf5d422-6536-4480-9a56-b2075c14f9fd tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5cf5d422-6536-4480-9a56-b2075c14f9fd tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:33 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5cf5d422-6536-4480-9a56-b2075c14f9fd tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5cf5d422-6536-4480-9a56-b2075c14f9fd tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:33 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5cf5d422-6536-4480-9a56-b2075c14f9fd tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:33 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:00:33 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:34 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f994dc15-ad44-4f1b-9eef-69af82c76c4d tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "cinder-15259987-3121-49fa-b6b7-f04701b8fedb-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5cf5d422-6536-4480-9a56-b2075c14f9fd tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 1.025s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:34 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-5cf5d422-6536-4480-9a56-b2075c14f9fd tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:00:34 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-5cf5d422-6536-4480-9a56-b2075c14f9fd tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Deleted volume successfully. Apr 28 06:00:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f994dc15-ad44-4f1b-9eef-69af82c76c4d tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-15259987-3121-49fa-b6b7-f04701b8fedb-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5cf5d422-6536-4480-9a56-b2075c14f9fd tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-ddcdaad9-0d5e-49c7-af01-df1d812be96a-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f994dc15-ad44-4f1b-9eef-69af82c76c4d tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "cinder-quobyte-15259987-3121-49fa-b6b7-f04701b8fedb" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f994dc15-ad44-4f1b-9eef-69af82c76c4d tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-quobyte-15259987-3121-49fa-b6b7-f04701b8fedb" acquired by "delete_volume" :: waited 0.050s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:34 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c56d9c8-00fd-46f4-9ae3-92671a1cfc72]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f994dc15-ad44-4f1b-9eef-69af82c76c4d tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-15259987-3121-49fa-b6b7-f04701b8fedb {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:34 devstack sudo[91129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-15259987-3121-49fa-b6b7-f04701b8fedb Apr 28 06:00:34 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:36 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f994dc15-ad44-4f1b-9eef-69af82c76c4d tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-15259987-3121-49fa-b6b7-f04701b8fedb" returned: 0 in 1.641s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:36 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f994dc15-ad44-4f1b-9eef-69af82c76c4d tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-15259987-3121-49fa-b6b7-f04701b8fedb {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:36 devstack sudo[91134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-15259987-3121-49fa-b6b7-f04701b8fedb Apr 28 06:00:36 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:37 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Flow 'volume_create_manager' (cdb6f700-92e4-4964-ae8a-1121736b93d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97dcf532-3a22-4f81-b552-a3d308c29ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97dcf532-3a22-4f81-b552-a3d308c29ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1592094015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47dd9929-8c40-427d-a9ec-baa763df3902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbd0ed1459b43edbea781a54e7f6e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:37Z,use_quota=True,user_id='dfde5fc8bc6f4d20b14807e828927e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff1f813-1a24-4603-9aa0-a9c0eeaf3d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff1f813-1a24-4603-9aa0-a9c0eeaf3d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3476c04-837b-4b8e-bcab-7d2770baf496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3476c04-837b-4b8e-bcab-7d2770baf496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47dd9929-8c40-427d-a9ec-baa763df3902', 'volume_name': 'volume-47dd9929-8c40-427d-a9ec-baa763df3902', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bebed0e8-9b7d-4a6f-8714-c635949502df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bebed0e8-9b7d-4a6f-8714-c635949502df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:37 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720cb873-d478-4960-89ab-57386af50162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:37 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Volume 47dd9929-8c40-427d-a9ec-baa763df3902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47dd9929-8c40-427d-a9ec-baa763df3902', 'volume_size': 1} Apr 28 06:00:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:37 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f994dc15-ad44-4f1b-9eef-69af82c76c4d tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-15259987-3121-49fa-b6b7-f04701b8fedb" returned: 0 in 1.572s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:37 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f994dc15-ad44-4f1b-9eef-69af82c76c4d tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-quobyte-15259987-3121-49fa-b6b7-f04701b8fedb" released by "delete_volume" :: held 3.293s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:37 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-f994dc15-ad44-4f1b-9eef-69af82c76c4d tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Created reservations ['441d730a-f8d7-48b4-9a5b-e264c31fbc06', 'a9b833de-98cd-4575-9b9e-e553d12607f6', 'dfb4da1b-63a6-40e3-b57d-fa5ad8c5d51b', 'efc52baf-b9f0-4cd0-8d3b-2e7b95245133'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:00:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f994dc15-ad44-4f1b-9eef-69af82c76c4d tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f994dc15-ad44-4f1b-9eef-69af82c76c4d tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:37 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f994dc15-ad44-4f1b-9eef-69af82c76c4d tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:37 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-f994dc15-ad44-4f1b-9eef-69af82c76c4d tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-f994dc15-ad44-4f1b-9eef-69af82c76c4d tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:37 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f994dc15-ad44-4f1b-9eef-69af82c76c4d tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:37 devstack sudo[91137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:00:37 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:38 devstack sudo[91109]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f57a65b-9b19-4157-8f57-986827a37b96" returned: 0 in 5.826s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:38 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[4687184b-e869-4b4c-b591-6ba006c10213]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:38 devstack sudo[91139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d Apr 28 06:00:38 devstack sudo[91139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:38 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-f994dc15-ad44-4f1b-9eef-69af82c76c4d tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.521s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:38 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-f994dc15-ad44-4f1b-9eef-69af82c76c4d tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:00:38 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-f994dc15-ad44-4f1b-9eef-69af82c76c4d tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Deleted volume successfully. Apr 28 06:00:38 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-f994dc15-ad44-4f1b-9eef-69af82c76c4d tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-15259987-3121-49fa-b6b7-f04701b8fedb-delete_volume" released by "delete_volume" :: held 4.260s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:38 devstack sudo[91139]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d" returned: 0 in 0.648s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:38 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Image conversion details: src /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f57a65b-9b19-4157-8f57-986827a37b96 {{(pid=81829) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 06:00:38 devstack cinder-volume[81829]: INFO cinder.image.image_utils [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Converted 1024.00 MB image at 175.71 MB/s Apr 28 06:00:38 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f57a65b-9b19-4157-8f57-986827a37b96 is being set with open permissions: ugo+rw Apr 28 06:00:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f57a65b-9b19-4157-8f57-986827a37b96 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:38 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f57a65b-9b19-4157-8f57-986827a37b96 Apr 28 06:00:38 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a783d4c3-94db-480d-97ce-4a922b539df0 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "cinder-6fdc4371-1790-438a-acaf-6168e812e5ed-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:38 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:38 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a783d4c3-94db-480d-97ce-4a922b539df0 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-6fdc4371-1790-438a-acaf-6168e812e5ed-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:38 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a783d4c3-94db-480d-97ce-4a922b539df0 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "cinder-quobyte-6fdc4371-1790-438a-acaf-6168e812e5ed" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:38 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a783d4c3-94db-480d-97ce-4a922b539df0 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-quobyte-6fdc4371-1790-438a-acaf-6168e812e5ed" acquired by "delete_volume" :: waited 0.012s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:38 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[d208f174-b6dc-4750-ac18-11d8239f6a24]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:38 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a783d4c3-94db-480d-97ce-4a922b539df0 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6fdc4371-1790-438a-acaf-6168e812e5ed {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:39 devstack sudo[91147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6fdc4371-1790-438a-acaf-6168e812e5ed Apr 28 06:00:39 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:39 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f57a65b-9b19-4157-8f57-986827a37b96" returned: 0 in 0.448s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Lock "cinder-quobyte-3f57a65b-9b19-4157-8f57-986827a37b96" released by "_copy_volume_from_snapshot" :: held 8.271s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Lock "cinder-quobyte-e23dad47-0e65-46c0-95f7-db07ca393703-3f57a65b-9b19-4157-8f57-986827a37b96" released by "_create_volume_from_snapshot" :: held 8.315s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.358s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.330s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-760930035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143796a1-9c7a-41c3-b0cd-6d105274b974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa648f5fe6844e19e937aa31649bef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:30Z,use_quota=True,user_id='ab63b2c0af344ba4ab9c9ed4e6c48ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Creating volume 143796a1-9c7a-41c3-b0cd-6d105274b974 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:00:39 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:39 devstack sudo[91150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974 1073741824 Apr 28 06:00:39 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:UPDATE=114,cinder:INSERT=29,cinder:DELETE=16,cinder:SELECT=80 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de17f5ac-b8d6-4ec6-8043-5ce0cb456fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f57a65b-9b19-4157-8f57-986827a37b96', 'volume_size': 1, 'snapshot_id': 'e23dad47-0e65-46c0-95f7-db07ca393703'}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc4f56f-e77d-4c5a-be57-57ed1d6d061b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:39 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Volume volume-3f57a65b-9b19-4157-8f57-986827a37b96 (3f57a65b-9b19-4157-8f57-986827a37b96): created successfully Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc4f56f-e77d-4c5a-be57-57ed1d6d061b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Flow 'volume_create_manager' (7f41f261-568f-40de-82c6-de6e3cddd0d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:39 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-1a0cabe7-00b3-4626-a3d2-92cb60cfce2f tempest-VolumeDependencyTests-41616770 None] Created volume successfully. Apr 28 06:00:39 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a783d4c3-94db-480d-97ce-4a922b539df0 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6fdc4371-1790-438a-acaf-6168e812e5ed" returned: 0 in 0.560s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a783d4c3-94db-480d-97ce-4a922b539df0 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6fdc4371-1790-438a-acaf-6168e812e5ed {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:39 devstack sudo[91155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6fdc4371-1790-438a-acaf-6168e812e5ed Apr 28 06:00:39 devstack sudo[91155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:39 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974 1073741824" returned: 0 in 0.637s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:39 devstack sudo[91155]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a783d4c3-94db-480d-97ce-4a922b539df0 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6fdc4371-1790-438a-acaf-6168e812e5ed" returned: 0 in 0.465s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:39 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a783d4c3-94db-480d-97ce-4a922b539df0 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-quobyte-6fdc4371-1790-438a-acaf-6168e812e5ed" released by "delete_volume" :: held 1.075s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:39 devstack sudo[91161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974 Apr 28 06:00:39 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-a783d4c3-94db-480d-97ce-4a922b539df0 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Created reservations ['b6c8ab5d-6b99-4ccb-bc10-17a1fe9d74f9', 'ebef6ecc-6cbf-4b1c-8197-19e0b8675f81', '3434994f-ccd6-4cbe-a74f-997951e93b0d', 'c65e9b1d-c6a8-4a25-9ba9-05d012b39907'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a783d4c3-94db-480d-97ce-4a922b539df0 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a783d4c3-94db-480d-97ce-4a922b539df0 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a783d4c3-94db-480d-97ce-4a922b539df0 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a783d4c3-94db-480d-97ce-4a922b539df0 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a783d4c3-94db-480d-97ce-4a922b539df0 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a783d4c3-94db-480d-97ce-4a922b539df0 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:40 devstack sudo[91163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:00:40 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-648d9b88-1372-47b4-b3b7-a3a70533b0ed tempest-VolumeDependencyTests-41616770 None] Acquiring lock "cinder-e23dad47-0e65-46c0-95f7-db07ca393703-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-648d9b88-1372-47b4-b3b7-a3a70533b0ed tempest-VolumeDependencyTests-41616770 None] Lock "cinder-e23dad47-0e65-46c0-95f7-db07ca393703-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-648d9b88-1372-47b4-b3b7-a3a70533b0ed tempest-VolumeDependencyTests-41616770 None] Acquiring lock "cinder-quobyte-0e03845e-ef1a-4566-9160-53f17841803d" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-648d9b88-1372-47b4-b3b7-a3a70533b0ed tempest-VolumeDependencyTests-41616770 None] Lock "cinder-quobyte-0e03845e-ef1a-4566-9160-53f17841803d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-648d9b88-1372-47b4-b3b7-a3a70533b0ed tempest-VolumeDependencyTests-41616770 None] Acquiring lock "cinder-quobyte-e23dad47-0e65-46c0-95f7-db07ca393703" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:40 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974" returned: 0 in 0.530s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-648d9b88-1372-47b4-b3b7-a3a70533b0ed tempest-VolumeDependencyTests-41616770 None] Lock "cinder-quobyte-e23dad47-0e65-46c0-95f7-db07ca393703" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-648d9b88-1372-47b4-b3b7-a3a70533b0ed tempest-VolumeDependencyTests-41616770 None] Deleting offline snapshot e23dad47-0e65-46c0-95f7-db07ca393703 of volume 0e03845e-ef1a-4566-9160-53f17841803d {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-648d9b88-1372-47b4-b3b7-a3a70533b0ed tempest-VolumeDependencyTests-41616770 None] snapshot_file for this snap is: volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.352s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1592094015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47dd9929-8c40-427d-a9ec-baa763df3902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbd0ed1459b43edbea781a54e7f6e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:37Z,use_quota=True,user_id='dfde5fc8bc6f4d20b14807e828927e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Creating volume 47dd9929-8c40-427d-a9ec-baa763df3902 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:00:40 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8ba723-ec74-4290-9ec5-8ec780823637]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-648d9b88-1372-47b4-b3b7-a3a70533b0ed tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:40 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902 1073741824 Apr 28 06:00:40 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba35d0d1-0773-4c63-960b-56c90da8e56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-143796a1-9c7a-41c3-b0cd-6d105274b974', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ba2777-675a-4ebf-afda-6ad14a986e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:40 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Volume volume-143796a1-9c7a-41c3-b0cd-6d105274b974 (143796a1-9c7a-41c3-b0cd-6d105274b974): created successfully Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ba2777-675a-4ebf-afda-6ad14a986e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Flow 'volume_create_manager' (85bd8fc2-381b-465f-a457-39983eac4d91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:40 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a783d4c3-94db-480d-97ce-4a922b539df0 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.498s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-a783d4c3-94db-480d-97ce-4a922b539df0 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:00:40 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-a783d4c3-94db-480d-97ce-4a922b539df0 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Deleted volume successfully. Apr 28 06:00:40 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-20b0a51c-2cc5-479d-9953-146964c37b0b tempest-SnapshotDependencyTests-2100990487 None] Created volume successfully. Apr 28 06:00:40 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a783d4c3-94db-480d-97ce-4a922b539df0 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-6fdc4371-1790-438a-acaf-6168e812e5ed-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:40 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703 Apr 28 06:00:40 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c60251ef-1419-49f9-bfd3-7871794dd496 tempest-SnapshotDependencyTests-2100990487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0fac1e01-4df5-4ab8-91df-395ec0405c14 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "cinder-0d385987-53a2-4113-9db3-d938f7f8fc50-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0fac1e01-4df5-4ab8-91df-395ec0405c14 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-0d385987-53a2-4113-9db3-d938f7f8fc50-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0fac1e01-4df5-4ab8-91df-395ec0405c14 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "cinder-quobyte-0d385987-53a2-4113-9db3-d938f7f8fc50" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0fac1e01-4df5-4ab8-91df-395ec0405c14 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-quobyte-0d385987-53a2-4113-9db3-d938f7f8fc50" acquired by "delete_volume" :: waited 0.023s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ea8ffa-4a66-4111-a7e4-c61543f27c5f]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0fac1e01-4df5-4ab8-91df-395ec0405c14 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0d385987-53a2-4113-9db3-d938f7f8fc50 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:41 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-648d9b88-1372-47b4-b3b7-a3a70533b0ed tempest-VolumeDependencyTests-41616770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703" returned: 0 in 0.697s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-648d9b88-1372-47b4-b3b7-a3a70533b0ed tempest-VolumeDependencyTests-41616770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e03845e-ef1a-4566-9160-53f17841803d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5d28ef-68a0-49a9-b581-ae1f2dbb72c4]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-648d9b88-1372-47b4-b3b7-a3a70533b0ed tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:41 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902 1073741824" returned: 0 in 0.749s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:41 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0d385987-53a2-4113-9db3-d938f7f8fc50 Apr 28 06:00:41 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:41 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902 Apr 28 06:00:41 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:41 devstack sudo[91179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d Apr 28 06:00:41 devstack sudo[91179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:41 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0fac1e01-4df5-4ab8-91df-395ec0405c14 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0d385987-53a2-4113-9db3-d938f7f8fc50" returned: 0 in 0.555s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0fac1e01-4df5-4ab8-91df-395ec0405c14 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0d385987-53a2-4113-9db3-d938f7f8fc50 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:41 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902" returned: 0 in 0.470s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:41 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0d385987-53a2-4113-9db3-d938f7f8fc50 Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c60251ef-1419-49f9-bfd3-7871794dd496 tempest-SnapshotDependencyTests-2100990487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.728s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:41 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:41 devstack sudo[91179]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720cb873-d478-4960-89ab-57386af50162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47dd9929-8c40-427d-a9ec-baa763df3902', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4e4afb-79a6-4d39-aecd-20e7bb563564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-c60251ef-1419-49f9-bfd3-7871794dd496 tempest-SnapshotDependencyTests-2100990487 None] Creating offline snapshot 1976ff43-b823-497e-aa1f-338129990900 of volume 143796a1-9c7a-41c3-b0cd-6d105274b974 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-648d9b88-1372-47b4-b3b7-a3a70533b0ed tempest-VolumeDependencyTests-41616770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d" returned: 0 in 0.559s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-648d9b88-1372-47b4-b3b7-a3a70533b0ed tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bd5d9c-5814-4f38-a8d7-641c375e6305]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:41 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Volume volume-47dd9929-8c40-427d-a9ec-baa763df3902 (47dd9929-8c40-427d-a9ec-baa763df3902): created successfully Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4e4afb-79a6-4d39-aecd-20e7bb563564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:41 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703 Apr 28 06:00:41 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Flow 'volume_create_manager' (cdb6f700-92e4-4964-ae8a-1121736b93d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:41 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c60251ef-1419-49f9-bfd3-7871794dd496 tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:41 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-9735056a-a891-449e-851f-c02ed0e57503 tempest-CreateVolumesFromSnapshotTest-841124067 None] Created volume successfully. Apr 28 06:00:41 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974 Apr 28 06:00:41 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:42 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0fac1e01-4df5-4ab8-91df-395ec0405c14 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0d385987-53a2-4113-9db3-d938f7f8fc50" returned: 0 in 0.474s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:42 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0fac1e01-4df5-4ab8-91df-395ec0405c14 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-quobyte-0d385987-53a2-4113-9db3-d938f7f8fc50" released by "delete_volume" :: held 1.076s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:42 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-0fac1e01-4df5-4ab8-91df-395ec0405c14 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Created reservations ['92434d74-72a5-48d6-8d04-09f0a63c9c31', 'eb66aaaa-a3ab-46ed-a9a6-26542d297e83', '779ebaa5-ad17-4999-b3ae-850aa6728b02', 'b1b4b040-53d0-4ec0-aff8-7d07532ba337'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:00:42 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-648d9b88-1372-47b4-b3b7-a3a70533b0ed tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703" returned: 0 in 0.551s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-648d9b88-1372-47b4-b3b7-a3a70533b0ed tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:42 devstack sudo[91203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703 Apr 28 06:00:42 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0fac1e01-4df5-4ab8-91df-395ec0405c14 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0fac1e01-4df5-4ab8-91df-395ec0405c14 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-0fac1e01-4df5-4ab8-91df-395ec0405c14 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:42 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-0fac1e01-4df5-4ab8-91df-395ec0405c14 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0fac1e01-4df5-4ab8-91df-395ec0405c14 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0fac1e01-4df5-4ab8-91df-395ec0405c14 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:42 devstack sudo[91206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:00:42 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ea976c84-f9a3-4186-be07-e89605968e29 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:42 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c60251ef-1419-49f9-bfd3-7871794dd496 tempest-SnapshotDependencyTests-2100990487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974" returned: 0 in 0.694s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c60251ef-1419-49f9-bfd3-7871794dd496 tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:42 devstack sudo[91208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900 1G Apr 28 06:00:42 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:42 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-648d9b88-1372-47b4-b3b7-a3a70533b0ed tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d.e23dad47-0e65-46c0-95f7-db07ca393703" returned: 0 in 0.495s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:42 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-648d9b88-1372-47b4-b3b7-a3a70533b0ed tempest-VolumeDependencyTests-41616770 None] Lock "cinder-quobyte-e23dad47-0e65-46c0-95f7-db07ca393703" released by "_delete_snapshot" :: held 2.411s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:42 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-648d9b88-1372-47b4-b3b7-a3a70533b0ed tempest-VolumeDependencyTests-41616770 None] Lock "cinder-quobyte-0e03845e-ef1a-4566-9160-53f17841803d" released by "delete_snapshot" :: held 2.444s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:42 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:42 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0fac1e01-4df5-4ab8-91df-395ec0405c14 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.511s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:42 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-0fac1e01-4df5-4ab8-91df-395ec0405c14 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:00:42 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-0fac1e01-4df5-4ab8-91df-395ec0405c14 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Deleted volume successfully. Apr 28 06:00:42 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0fac1e01-4df5-4ab8-91df-395ec0405c14 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-0d385987-53a2-4113-9db3-d938f7f8fc50-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:43 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-648d9b88-1372-47b4-b3b7-a3a70533b0ed tempest-VolumeDependencyTests-41616770 None] Created reservations ['c6ec5d15-0324-4ba8-9c14-a05fe74b0bd2', 'bca4630f-26a3-45a6-8b68-ad6ea1296335', 'a4b232e5-403e-4b91-ada3-458e3a014066', '5c3c1c9a-f233-4c59-8f74-78ccca156e3a'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:00:43 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-648d9b88-1372-47b4-b3b7-a3a70533b0ed tempest-VolumeDependencyTests-41616770 None] Delete snapshot completed successfully. Apr 28 06:00:43 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-648d9b88-1372-47b4-b3b7-a3a70533b0ed tempest-VolumeDependencyTests-41616770 None] Lock "cinder-e23dad47-0e65-46c0-95f7-db07ca393703-delete_snapshot" released by "delete_snapshot" :: held 2.603s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:43 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c60251ef-1419-49f9-bfd3-7871794dd496 tempest-SnapshotDependencyTests-2100990487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900 1G" returned: 0 in 0.640s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c60251ef-1419-49f9-bfd3-7871794dd496 tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-143796a1-9c7a-41c3-b0cd-6d105274b974 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:43 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-143796a1-9c7a-41c3-b0cd-6d105274b974 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900 Apr 28 06:00:43 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:43 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cc64012f-a42c-4534-b8aa-30cfdd619260 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "cinder-4c98a28d-1ef0-4da4-8abf-38b0cb160bce-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:43 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cc64012f-a42c-4534-b8aa-30cfdd619260 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-4c98a28d-1ef0-4da4-8abf-38b0cb160bce-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:43 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cc64012f-a42c-4534-b8aa-30cfdd619260 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "cinder-quobyte-4c98a28d-1ef0-4da4-8abf-38b0cb160bce" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:43 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cc64012f-a42c-4534-b8aa-30cfdd619260 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-quobyte-4c98a28d-1ef0-4da4-8abf-38b0cb160bce" acquired by "delete_volume" :: waited 0.013s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:43 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[0623961e-6ca4-4f66-91f4-06e1be507f2b]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cc64012f-a42c-4534-b8aa-30cfdd619260 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4c98a28d-1ef0-4da4-8abf-38b0cb160bce {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:43 devstack sudo[91217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4c98a28d-1ef0-4da4-8abf-38b0cb160bce Apr 28 06:00:43 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:43 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-937ad7fb-452d-46b6-89ec-ca573bd134ae tempest-VolumeDependencyTests-41616770 None] Acquiring lock "cinder-0e03845e-ef1a-4566-9160-53f17841803d-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:43 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-937ad7fb-452d-46b6-89ec-ca573bd134ae tempest-VolumeDependencyTests-41616770 None] Lock "cinder-0e03845e-ef1a-4566-9160-53f17841803d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:43 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:UPDATE=170,cinder:SELECT=113,cinder:DELETE=12,cinder:INSERT=33 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 06:00:43 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-937ad7fb-452d-46b6-89ec-ca573bd134ae tempest-VolumeDependencyTests-41616770 None] Acquiring lock "cinder-quobyte-0e03845e-ef1a-4566-9160-53f17841803d" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:43 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-937ad7fb-452d-46b6-89ec-ca573bd134ae tempest-VolumeDependencyTests-41616770 None] Lock "cinder-quobyte-0e03845e-ef1a-4566-9160-53f17841803d" acquired by "delete_volume" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:43 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbceef0b-c71a-45f7-bee8-eb43cce633b4]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-937ad7fb-452d-46b6-89ec-ca573bd134ae tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:43 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c60251ef-1419-49f9-bfd3-7871794dd496 tempest-SnapshotDependencyTests-2100990487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-143796a1-9c7a-41c3-b0cd-6d105274b974 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900" returned: 0 in 0.629s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:43 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-c60251ef-1419-49f9-bfd3-7871794dd496 tempest-SnapshotDependencyTests-2100990487 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900 is being set with open permissions: ugo+rw Apr 28 06:00:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c60251ef-1419-49f9-bfd3-7871794dd496 tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:43 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d Apr 28 06:00:43 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:43 devstack sudo[91223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900 Apr 28 06:00:43 devstack sudo[91223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:43 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cc64012f-a42c-4534-b8aa-30cfdd619260 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4c98a28d-1ef0-4da4-8abf-38b0cb160bce" returned: 0 in 0.553s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:43 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cc64012f-a42c-4534-b8aa-30cfdd619260 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4c98a28d-1ef0-4da4-8abf-38b0cb160bce {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:44 devstack sudo[91229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4c98a28d-1ef0-4da4-8abf-38b0cb160bce Apr 28 06:00:44 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:44 devstack sudo[91223]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c60251ef-1419-49f9-bfd3-7871794dd496 tempest-SnapshotDependencyTests-2100990487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900" returned: 0 in 0.470s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:44 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c60251ef-1419-49f9-bfd3-7871794dd496 tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-937ad7fb-452d-46b6-89ec-ca573bd134ae tempest-VolumeDependencyTests-41616770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d" returned: 0 in 0.568s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-937ad7fb-452d-46b6-89ec-ca573bd134ae tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:44 devstack sudo[91235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.info Apr 28 06:00:44 devstack sudo[91235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:44 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d Apr 28 06:00:44 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:44 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cc64012f-a42c-4534-b8aa-30cfdd619260 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-4c98a28d-1ef0-4da4-8abf-38b0cb160bce" returned: 0 in 0.498s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cc64012f-a42c-4534-b8aa-30cfdd619260 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-quobyte-4c98a28d-1ef0-4da4-8abf-38b0cb160bce" released by "delete_volume" :: held 1.096s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-cc64012f-a42c-4534-b8aa-30cfdd619260 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Created reservations ['30ff40ff-b839-4552-850d-1f237f93726a', 'b8d0f3b2-b35d-4fd3-8c5c-4ff422498a13', '6d1c5df2-7280-4f6d-b4a9-bca68c08e932', '9cb9c6ef-a6be-45bd-8dbd-ec5bb1247b0e'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cc64012f-a42c-4534-b8aa-30cfdd619260 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cc64012f-a42c-4534-b8aa-30cfdd619260 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cc64012f-a42c-4534-b8aa-30cfdd619260 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-cc64012f-a42c-4534-b8aa-30cfdd619260 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-cc64012f-a42c-4534-b8aa-30cfdd619260 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cc64012f-a42c-4534-b8aa-30cfdd619260 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:44 devstack sudo[91240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:00:44 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:44 devstack sudo[91235]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c60251ef-1419-49f9-bfd3-7871794dd496 tempest-SnapshotDependencyTests-2100990487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.info" returned: 0 in 0.494s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:44 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-c60251ef-1419-49f9-bfd3-7871794dd496 tempest-SnapshotDependencyTests-2100990487 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.info is being set with open permissions: ugo+rw Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c60251ef-1419-49f9-bfd3-7871794dd496 tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:44 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-937ad7fb-452d-46b6-89ec-ca573bd134ae tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-0e03845e-ef1a-4566-9160-53f17841803d" returned: 0 in 0.497s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:44 devstack sudo[91244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.info Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-937ad7fb-452d-46b6-89ec-ca573bd134ae tempest-VolumeDependencyTests-41616770 None] Lock "cinder-quobyte-0e03845e-ef1a-4566-9160-53f17841803d" released by "delete_volume" :: held 1.123s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:44 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-937ad7fb-452d-46b6-89ec-ca573bd134ae tempest-VolumeDependencyTests-41616770 None] Created reservations ['ad9bc8c3-cc03-4111-a986-e2423ab6a0cf', 'e214c74d-76c8-4af7-8978-9fa6f597e197', 'c6634d22-784d-44dc-9001-d4d11690ca5a', 'fad2a984-c79d-4e5f-ab9a-e603cb484de7'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-937ad7fb-452d-46b6-89ec-ca573bd134ae tempest-VolumeDependencyTests-41616770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-937ad7fb-452d-46b6-89ec-ca573bd134ae tempest-VolumeDependencyTests-41616770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-937ad7fb-452d-46b6-89ec-ca573bd134ae tempest-VolumeDependencyTests-41616770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-937ad7fb-452d-46b6-89ec-ca573bd134ae tempest-VolumeDependencyTests-41616770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-937ad7fb-452d-46b6-89ec-ca573bd134ae tempest-VolumeDependencyTests-41616770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:44 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-937ad7fb-452d-46b6-89ec-ca573bd134ae tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:44 devstack sudo[91246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:00:44 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:45 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-cc64012f-a42c-4534-b8aa-30cfdd619260 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.491s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:45 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-cc64012f-a42c-4534-b8aa-30cfdd619260 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:00:45 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-cc64012f-a42c-4534-b8aa-30cfdd619260 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Deleted volume successfully. Apr 28 06:00:45 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-cc64012f-a42c-4534-b8aa-30cfdd619260 tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-4c98a28d-1ef0-4da4-8abf-38b0cb160bce-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:45 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c60251ef-1419-49f9-bfd3-7871794dd496 tempest-SnapshotDependencyTests-2100990487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.info" returned: 0 in 0.469s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c60251ef-1419-49f9-bfd3-7871794dd496 tempest-SnapshotDependencyTests-2100990487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.522s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ea976c84-f9a3-4186-be07-e89605968e29 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.793s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:45 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-ea976c84-f9a3-4186-be07-e89605968e29 tempest-CreateVolumesFromSnapshotTest-841124067 None] Creating offline snapshot 68a8eb3a-09ba-4b7f-877c-c6f82fb38410 of volume 47dd9929-8c40-427d-a9ec-baa763df3902 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 06:00:45 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-c60251ef-1419-49f9-bfd3-7871794dd496 tempest-SnapshotDependencyTests-2100990487 None] Create snapshot completed successfully Apr 28 06:00:45 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[be18d62a-1620-4d34-a041-69e033963a32]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ea976c84-f9a3-4186-be07-e89605968e29 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:45 devstack sudo[91251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902 Apr 28 06:00:45 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:45 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-937ad7fb-452d-46b6-89ec-ca573bd134ae tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.500s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:45 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-937ad7fb-452d-46b6-89ec-ca573bd134ae tempest-VolumeDependencyTests-41616770 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:00:45 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-937ad7fb-452d-46b6-89ec-ca573bd134ae tempest-VolumeDependencyTests-41616770 None] Deleted volume successfully. Apr 28 06:00:45 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-937ad7fb-452d-46b6-89ec-ca573bd134ae tempest-VolumeDependencyTests-41616770 None] Lock "cinder-0e03845e-ef1a-4566-9160-53f17841803d-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:45 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-957e9051-95f0-4348-b87b-a78759bb552c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "cinder-94a0ceab-d38a-4512-b534-283333fc5a26-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:45 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-957e9051-95f0-4348-b87b-a78759bb552c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-94a0ceab-d38a-4512-b534-283333fc5a26-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:45 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-957e9051-95f0-4348-b87b-a78759bb552c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "cinder-quobyte-94a0ceab-d38a-4512-b534-283333fc5a26" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:45 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-957e9051-95f0-4348-b87b-a78759bb552c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-quobyte-94a0ceab-d38a-4512-b534-283333fc5a26" acquired by "delete_volume" :: waited 0.013s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:45 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8997b4-c647-4011-a254-038dd531de18]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:45 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-957e9051-95f0-4348-b87b-a78759bb552c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-94a0ceab-d38a-4512-b534-283333fc5a26 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:45 devstack sudo[91253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-94a0ceab-d38a-4512-b534-283333fc5a26 Apr 28 06:00:45 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:46 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ea976c84-f9a3-4186-be07-e89605968e29 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902" returned: 0 in 0.652s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ea976c84-f9a3-4186-be07-e89605968e29 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.68a8eb3a-09ba-4b7f-877c-c6f82fb38410 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:46 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.68a8eb3a-09ba-4b7f-877c-c6f82fb38410 1G Apr 28 06:00:46 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Flow 'volume_create_manager' (ee013243-10be-43b1-8dd8-4184cfda55da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:46 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22c73c84-9e33-427b-a63f-1218b134da79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-957e9051-95f0-4348-b87b-a78759bb552c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-94a0ceab-d38a-4512-b534-283333fc5a26" returned: 0 in 0.631s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-957e9051-95f0-4348-b87b-a78759bb552c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-94a0ceab-d38a-4512-b534-283333fc5a26 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22c73c84-9e33-427b-a63f-1218b134da79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1723632217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e01ec18-3a5f-4718-9b4b-ff55580e7d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f789a2e8d697489d9bb0f4870f08c299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:46Z,use_quota=True,user_id='407c0a8b44cc46f28c3e65b716948721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:46 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-94a0ceab-d38a-4512-b534-283333fc5a26 Apr 28 06:00:46 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002c7bf8-bb58-4000-9484-25eb4216fd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002c7bf8-bb58-4000-9484-25eb4216fd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a45bd7-2596-478e-b21b-eb8024159e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5a45bd7-2596-478e-b21b-eb8024159e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e01ec18-3a5f-4718-9b4b-ff55580e7d7f', 'volume_name': 'volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f14d05-5eb9-468d-98b4-17cf4cdd449c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f14d05-5eb9-468d-98b4-17cf4cdd449c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f22bcf-faf0-47f4-bfe5-911a4da999ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:46 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Volume 7e01ec18-3a5f-4718-9b4b-ff55580e7d7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f', 'volume_size': 1} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:46 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ea976c84-f9a3-4186-be07-e89605968e29 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.68a8eb3a-09ba-4b7f-877c-c6f82fb38410 1G" returned: 0 in 0.763s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ea976c84-f9a3-4186-be07-e89605968e29 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47dd9929-8c40-427d-a9ec-baa763df3902 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.68a8eb3a-09ba-4b7f-877c-c6f82fb38410 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:46 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47dd9929-8c40-427d-a9ec-baa763df3902 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.68a8eb3a-09ba-4b7f-877c-c6f82fb38410 Apr 28 06:00:46 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Flow 'volume_create_manager' (86b8cf16-b8f1-4377-87fd-b4ac7ada9e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b1e330-e76d-4abe-b22d-8a49ee912509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b1e330-e76d-4abe-b22d-8a49ee912509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88027f3b-38b7-42a8-8a97-0d55ce7d6d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa648f5fe6844e19e937aa31649bef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1976ff43-b823-497e-aa1f-338129990900,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:47Z,use_quota=True,user_id='ab63b2c0af344ba4ab9c9ed4e6c48ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5edf42-641f-4827-857e-10ecba0cfc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:46 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5edf42-641f-4827-857e-10ecba0cfc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea35075-e331-4a09-8984-963ef644eb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea35075-e331-4a09-8984-963ef644eb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '88027f3b-38b7-42a8-8a97-0d55ce7d6d69', 'volume_name': 'volume-88027f3b-38b7-42a8-8a97-0d55ce7d6d69', 'volume_size': 1, 'snapshot_id': '1976ff43-b823-497e-aa1f-338129990900'}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e418620e-d6a3-4249-87fc-d17b905205b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e418620e-d6a3-4249-87fc-d17b905205b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f1f7ae-54b1-44d1-acb2-9da173487699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:46 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Volume 88027f3b-38b7-42a8-8a97-0d55ce7d6d69: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-88027f3b-38b7-42a8-8a97-0d55ce7d6d69', 'volume_size': 1, 'snapshot_id': '1976ff43-b823-497e-aa1f-338129990900'} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-957e9051-95f0-4348-b87b-a78759bb552c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-94a0ceab-d38a-4512-b534-283333fc5a26" returned: 0 in 0.590s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-957e9051-95f0-4348-b87b-a78759bb552c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-quobyte-94a0ceab-d38a-4512-b534-283333fc5a26" released by "delete_volume" :: held 1.263s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:46 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-957e9051-95f0-4348-b87b-a78759bb552c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Created reservations ['466caf2b-2e20-404f-a988-fd42342d899e', '2d2346a6-47d5-4efd-a643-6f3acd8acec7', 'b8f2cccd-ee42-4a13-bd28-258ef3f116d1', '2b73686e-5239-4aa2-ad47-6ff55da1a9d9'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:00:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-957e9051-95f0-4348-b87b-a78759bb552c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-957e9051-95f0-4348-b87b-a78759bb552c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:47 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-957e9051-95f0-4348-b87b-a78759bb552c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:47 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-957e9051-95f0-4348-b87b-a78759bb552c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-957e9051-95f0-4348-b87b-a78759bb552c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-957e9051-95f0-4348-b87b-a78759bb552c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:47 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:00:47 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:47 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ea976c84-f9a3-4186-be07-e89605968e29 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47dd9929-8c40-427d-a9ec-baa763df3902 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.68a8eb3a-09ba-4b7f-877c-c6f82fb38410" returned: 0 in 0.543s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:47 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-ea976c84-f9a3-4186-be07-e89605968e29 tempest-CreateVolumesFromSnapshotTest-841124067 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.68a8eb3a-09ba-4b7f-877c-c6f82fb38410 is being set with open permissions: ugo+rw Apr 28 06:00:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ea976c84-f9a3-4186-be07-e89605968e29 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.68a8eb3a-09ba-4b7f-877c-c6f82fb38410 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:47 devstack sudo[91277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.68a8eb3a-09ba-4b7f-877c-c6f82fb38410 Apr 28 06:00:47 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:47 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-957e9051-95f0-4348-b87b-a78759bb552c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.474s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:47 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-957e9051-95f0-4348-b87b-a78759bb552c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:00:47 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-957e9051-95f0-4348-b87b-a78759bb552c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Deleted volume successfully. Apr 28 06:00:47 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-957e9051-95f0-4348-b87b-a78759bb552c tempest-CreateVolumesFromSourceVolumeTest-1517613595 None] Lock "cinder-94a0ceab-d38a-4512-b534-283333fc5a26-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:47 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ea976c84-f9a3-4186-be07-e89605968e29 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.68a8eb3a-09ba-4b7f-877c-c6f82fb38410" returned: 0 in 0.477s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:47 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ea976c84-f9a3-4186-be07-e89605968e29 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:47 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.info Apr 28 06:00:47 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:48 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ea976c84-f9a3-4186-be07-e89605968e29 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.info" returned: 0 in 0.509s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:48 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-ea976c84-f9a3-4186-be07-e89605968e29 tempest-CreateVolumesFromSnapshotTest-841124067 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.info is being set with open permissions: ugo+rw Apr 28 06:00:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ea976c84-f9a3-4186-be07-e89605968e29 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:48 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.info Apr 28 06:00:48 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:48 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ea976c84-f9a3-4186-be07-e89605968e29 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.info" returned: 0 in 0.520s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ea976c84-f9a3-4186-be07-e89605968e29 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.570s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.549s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:48 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1723632217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e01ec18-3a5f-4718-9b4b-ff55580e7d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f789a2e8d697489d9bb0f4870f08c299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:46Z,use_quota=True,user_id='407c0a8b44cc46f28c3e65b716948721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 06:00:48 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Creating volume 7e01ec18-3a5f-4718-9b4b-ff55580e7d7f {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 06:00:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:48 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:48 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:48 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:00:48 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 06:00:48 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:48 devstack sudo[91287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f 1073741824 Apr 28 06:00:48 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:48 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-ea976c84-f9a3-4186-be07-e89605968e29 tempest-CreateVolumesFromSnapshotTest-841124067 None] Create snapshot completed successfully Apr 28 06:00:49 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f 1073741824" returned: 0 in 0.654s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:49 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:49 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f Apr 28 06:00:49 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:50 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f" returned: 0 in 0.514s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.230s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Acquiring lock "cinder-quobyte-1976ff43-b823-497e-aa1f-338129990900-88027f3b-38b7-42a8-8a97-0d55ce7d6d69" by "_create_volume_from_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f22bcf-faf0-47f4-bfe5-911a4da999ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e294a3-db6b-439e-abd3-39eaee6b4510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:50 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Volume volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f (7e01ec18-3a5f-4718-9b4b-ff55580e7d7f): created successfully Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e294a3-db6b-439e-abd3-39eaee6b4510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Flow 'volume_create_manager' (ee013243-10be-43b1-8dd8-4184cfda55da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Lock "cinder-quobyte-1976ff43-b823-497e-aa1f-338129990900-88027f3b-38b7-42a8-8a97-0d55ce7d6d69" acquired by "_create_volume_from_snapshot" :: waited 0.103s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Creating volume 88027f3b-38b7-42a8-8a97-0d55ce7d6d69 from snapshot 1976ff43-b823-497e-aa1f-338129990900 {{(pid=81829) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Acquiring lock "cinder-quobyte-88027f3b-38b7-42a8-8a97-0d55ce7d6d69" by "_copy_volume_from_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Flow 'volume_create_manager' (2a23aa89-de89-4932-b20c-89aff6c164cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e8c0fb-3466-4d9e-88e5-f5c66b564df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:50 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-dbd71cad-a596-4044-9a23-0a68f904c3f9 tempest-VolumeDependencyTests-41616770 None] Created volume successfully. Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e8c0fb-3466-4d9e-88e5-f5c66b564df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-196880790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc1ed3f-b454-4f88-95b2-1bc42d838481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbd0ed1459b43edbea781a54e7f6e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:50Z,use_quota=True,user_id='dfde5fc8bc6f4d20b14807e828927e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3506d213-caf6-43fa-9634-cac9f51b4a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3506d213-caf6-43fa-9634-cac9f51b4a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39776e2-3188-4228-8789-e55de96a6c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39776e2-3188-4228-8789-e55de96a6c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbc1ed3f-b454-4f88-95b2-1bc42d838481', 'volume_name': 'volume-dbc1ed3f-b454-4f88-95b2-1bc42d838481', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267660cb-b1f8-44ab-8cd7-7b518c9dce37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267660cb-b1f8-44ab-8cd7-7b518c9dce37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c91f1d-af6d-4e49-8223-5090663dfa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:50 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Volume dbc1ed3f-b454-4f88-95b2-1bc42d838481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbc1ed3f-b454-4f88-95b2-1bc42d838481', 'volume_size': 1} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Lock "cinder-quobyte-88027f3b-38b7-42a8-8a97-0d55ce7d6d69" acquired by "_copy_volume_from_snapshot" :: waited 0.128s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] snapshot: 1976ff43-b823-497e-aa1f-338129990900, volume: 88027f3b-38b7-42a8-8a97-0d55ce7d6d69, {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1e9aae-465f-40e5-bbf8-2785aff33c4e]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Flow 'volume_create_manager' (c5b7c153-fb3b-4284-acb0-c48924a300b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ef4a9a-e86e-41fc-8864-03c477313b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:50 devstack sudo[91295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900 Apr 28 06:00:50 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ef4a9a-e86e-41fc-8864-03c477313b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f4a981-2bd6-49d6-82e0-e154a150dace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e572e9017b4f9fa5c85d3f0ce1bfa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:50Z,use_quota=True,user_id='e21a48e1d83e4430aaa5bcf647048b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830df399-c04a-4eec-bcc1-45a4c3ef2dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830df399-c04a-4eec-bcc1-45a4c3ef2dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9d3812-9aa9-4b39-b121-06fd63c93c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9d3812-9aa9-4b39-b121-06fd63c93c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9f4a981-2bd6-49d6-82e0-e154a150dace', 'volume_name': 'volume-f9f4a981-2bd6-49d6-82e0-e154a150dace', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0e7f06-2f35-4e1b-820f-69366426eebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0e7f06-2f35-4e1b-820f-69366426eebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87809e0-516d-4231-86bc-5d0e9f174d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:50 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Volume f9f4a981-2bd6-49d6-82e0-e154a150dace: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9f4a981-2bd6-49d6-82e0-e154a150dace', 'volume_size': 1} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Flow 'volume_create_manager' (d52ab974-a85e-455d-923a-aa8f929ad226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb82501c-3a22-4bbf-9408-7be090c1602d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb82501c-3a22-4bbf-9408-7be090c1602d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1376200755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1511b86d-4418-4fe7-b975-6f1370ee713c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbd0ed1459b43edbea781a54e7f6e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:50Z,use_quota=True,user_id='dfde5fc8bc6f4d20b14807e828927e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022f6f06-3d8c-4f15-a373-ea77edfdb999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022f6f06-3d8c-4f15-a373-ea77edfdb999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ebf30c-6813-49fc-a63d-8df626575126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ebf30c-6813-49fc-a63d-8df626575126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1511b86d-4418-4fe7-b975-6f1370ee713c', 'volume_name': 'volume-1511b86d-4418-4fe7-b975-6f1370ee713c', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df0a79b-faf8-449f-8261-a0541098c30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df0a79b-faf8-449f-8261-a0541098c30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5af00c-2265-4d13-9c58-653480105811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:50 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Volume 1511b86d-4418-4fe7-b975-6f1370ee713c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1511b86d-4418-4fe7-b975-6f1370ee713c', 'volume_size': 1} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Flow 'volume_create_manager' (0562a9f3-efa9-4aea-95ea-f2f082036826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1424093e-2414-47cc-a9dd-2c6cf2ed450f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1424093e-2414-47cc-a9dd-2c6cf2ed450f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1023882522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66577cac-f95e-40d7-921c-dc1f370db874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbd0ed1459b43edbea781a54e7f6e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:51Z,use_quota=True,user_id='dfde5fc8bc6f4d20b14807e828927e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe7771e-e0bc-4c75-9d41-015d1221c3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe7771e-e0bc-4c75-9d41-015d1221c3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233d3124-2a16-468d-975b-80392fb24390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233d3124-2a16-468d-975b-80392fb24390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66577cac-f95e-40d7-921c-dc1f370db874', 'volume_name': 'volume-66577cac-f95e-40d7-921c-dc1f370db874', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b5ef76-f700-428e-b3c8-405723dcb16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b5ef76-f700-428e-b3c8-405723dcb16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314b67fb-1bd1-4777-b911-beed93f13bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:50 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Volume 66577cac-f95e-40d7-921c-dc1f370db874: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66577cac-f95e-40d7-921c-dc1f370db874', 'volume_size': 1} Apr 28 06:00:50 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Flow 'volume_create_manager' (ca5dfc38-d4fa-4fb7-9026-3c5ea450592c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:51 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0128a578-8852-427a-b011-92dc9e0b504d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0128a578-8852-427a-b011-92dc9e0b504d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-147427545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1ece01-773d-4566-a0ce-5121aeae22a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f789a2e8d697489d9bb0f4870f08c299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7e01ec18-3a5f-4718-9b4b-ff55580e7d7f,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:51Z,use_quota=True,user_id='407c0a8b44cc46f28c3e65b716948721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1781e96-7fce-4017-9233-c4b7dee8dc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1781e96-7fce-4017-9233-c4b7dee8dc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5755ea-4509-4b6b-8bbb-0014994d07da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5755ea-4509-4b6b-8bbb-0014994d07da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6d1ece01-773d-4566-a0ce-5121aeae22a7', 'volume_name': 'volume-6d1ece01-773d-4566-a0ce-5121aeae22a7', 'volume_size': 1, 'source_volid': '7e01ec18-3a5f-4718-9b4b-ff55580e7d7f', 'source_volstatus': 'available'}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1b924d-27ba-4c86-af9d-a501a6d96894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1b924d-27ba-4c86-af9d-a501a6d96894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d75aa3c-aa88-4751-9981-cd28be7e7e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:51 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Volume 6d1ece01-773d-4566-a0ce-5121aeae22a7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6d1ece01-773d-4566-a0ce-5121aeae22a7', 'volume_size': 1, 'source_volid': '7e01ec18-3a5f-4718-9b4b-ff55580e7d7f', 'source_volstatus': 'available'} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900" returned: 0 in 0.774s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-143796a1-9c7a-41c3-b0cd-6d105274b974(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] will copy from snapshot at /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974 {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Creating direct copy from snapshot {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ab74e4-f059-4911-befd-e9365442fa9d]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Flow 'volume_create_manager' (92ca0473-f7c8-4bef-9d4f-e500453bb742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9ee821c-9565-48a2-becd-741e0bc6706f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9ee821c-9565-48a2-becd-741e0bc6706f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-590246068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f3da6b0-f84c-4432-9c86-ae1b40c7d12e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbd0ed1459b43edbea781a54e7f6e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:51Z,use_quota=True,user_id='dfde5fc8bc6f4d20b14807e828927e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef98e24-5e32-4299-93c2-f00cffd9fc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef98e24-5e32-4299-93c2-f00cffd9fc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226b19a4-933d-4236-a1e8-512dca61d08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226b19a4-933d-4236-a1e8-512dca61d08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f3da6b0-f84c-4432-9c86-ae1b40c7d12e', 'volume_name': 'volume-1f3da6b0-f84c-4432-9c86-ae1b40c7d12e', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2fde16-7d07-47ba-8dff-d6b2883dac7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2fde16-7d07-47ba-8dff-d6b2883dac7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e774f3-3938-4ead-bf26-77f7ecfc206c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:51 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Volume 1f3da6b0-f84c-4432-9c86-ae1b40c7d12e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f3da6b0-f84c-4432-9c86-ae1b40c7d12e', 'volume_size': 1} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:51 devstack sudo[91302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974 Apr 28 06:00:51 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Flow 'volume_create_manager' (ce5b4cf5-c59d-4a34-8de5-058b00350dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afbf3eac-dc99-442c-8860-51bfd4b4b3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afbf3eac-dc99-442c-8860-51bfd4b4b3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1958262074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85722779-e710-45ac-a1b2-468dfb3b204d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbd0ed1459b43edbea781a54e7f6e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:51Z,use_quota=True,user_id='dfde5fc8bc6f4d20b14807e828927e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba171b6-ae7a-4822-8801-f2cdb0a6bc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba171b6-ae7a-4822-8801-f2cdb0a6bc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc038e97-39d4-4011-9c84-f9c1188e9f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc038e97-39d4-4011-9c84-f9c1188e9f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85722779-e710-45ac-a1b2-468dfb3b204d', 'volume_name': 'volume-85722779-e710-45ac-a1b2-468dfb3b204d', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980563d9-2ee2-4e3a-b7e2-424ff07a2626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980563d9-2ee2-4e3a-b7e2-424ff07a2626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76b0411-8dcd-43e2-88b0-fb2084278f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:51 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Volume 85722779-e710-45ac-a1b2-468dfb3b204d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85722779-e710-45ac-a1b2-468dfb3b204d', 'volume_size': 1} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:51 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974" returned: 0 in 0.569s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG cinder.utils [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Path /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-88027f3b-38b7-42a8-8a97-0d55ce7d6d69 not found in is_blk_device check {{(pid=81829) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 06:00:51 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-88027f3b-38b7-42a8-8a97-0d55ce7d6d69 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:51 devstack sudo[91307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-88027f3b-38b7-42a8-8a97-0d55ce7d6d69 Apr 28 06:00:51 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:56 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-88027f3b-38b7-42a8-8a97-0d55ce7d6d69" returned: 0 in 4.767s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:56 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed15492-dff6-4f59-aa1d-7aaa275374f7]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:56 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:56 devstack sudo[91325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974 Apr 28 06:00:56 devstack sudo[91325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:57 devstack sudo[91325]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974" returned: 0 in 0.644s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:57 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Image conversion details: src /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974, size 1024.00 MB, duration 4.77 sec, destination /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-88027f3b-38b7-42a8-8a97-0d55ce7d6d69 {{(pid=81829) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 06:00:57 devstack cinder-volume[81829]: INFO cinder.image.image_utils [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Converted 1024.00 MB image at 214.77 MB/s Apr 28 06:00:57 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-88027f3b-38b7-42a8-8a97-0d55ce7d6d69 is being set with open permissions: ugo+rw Apr 28 06:00:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-88027f3b-38b7-42a8-8a97-0d55ce7d6d69 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:57 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-88027f3b-38b7-42a8-8a97-0d55ce7d6d69 Apr 28 06:00:57 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:57 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-88027f3b-38b7-42a8-8a97-0d55ce7d6d69" returned: 0 in 0.448s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Lock "cinder-quobyte-88027f3b-38b7-42a8-8a97-0d55ce7d6d69" released by "_copy_volume_from_snapshot" :: held 7.311s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:57 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Lock "cinder-quobyte-1976ff43-b823-497e-aa1f-338129990900-88027f3b-38b7-42a8-8a97-0d55ce7d6d69" released by "_create_volume_from_snapshot" :: held 7.456s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:00:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.562s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.337s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-196880790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc1ed3f-b454-4f88-95b2-1bc42d838481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbd0ed1459b43edbea781a54e7f6e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:50Z,use_quota=True,user_id='dfde5fc8bc6f4d20b14807e828927e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 06:00:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Creating volume dbc1ed3f-b454-4f88-95b2-1bc42d838481 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 06:00:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:57 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:00:57 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 06:00:57 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbc1ed3f-b454-4f88-95b2-1bc42d838481 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:57 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbc1ed3f-b454-4f88-95b2-1bc42d838481 1073741824 Apr 28 06:00:57 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f1f7ae-54b1-44d1-acb2-9da173487699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88027f3b-38b7-42a8-8a97-0d55ce7d6d69', 'volume_size': 1, 'snapshot_id': '1976ff43-b823-497e-aa1f-338129990900'}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0707578d-0cf4-450f-b385-d2e30b47d454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:57 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Volume volume-88027f3b-38b7-42a8-8a97-0d55ce7d6d69 (88027f3b-38b7-42a8-8a97-0d55ce7d6d69): created successfully Apr 28 06:00:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0707578d-0cf4-450f-b385-d2e30b47d454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:57 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Flow 'volume_create_manager' (86b8cf16-b8f1-4377-87fd-b4ac7ada9e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:57 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-1ce92eae-2076-4657-9af4-9d3b8a6a21a7 tempest-SnapshotDependencyTests-2100990487 None] Created volume successfully. Apr 28 06:00:58 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbc1ed3f-b454-4f88-95b2-1bc42d838481 1073741824" returned: 0 in 0.621s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbc1ed3f-b454-4f88-95b2-1bc42d838481 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:58 devstack sudo[91338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbc1ed3f-b454-4f88-95b2-1bc42d838481 Apr 28 06:00:58 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4dadd3b4-2928-4928-9e30-69d657a60a17 tempest-SnapshotDependencyTests-2100990487 None] Acquiring lock "cinder-1976ff43-b823-497e-aa1f-338129990900-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4dadd3b4-2928-4928-9e30-69d657a60a17 tempest-SnapshotDependencyTests-2100990487 None] Lock "cinder-1976ff43-b823-497e-aa1f-338129990900-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4dadd3b4-2928-4928-9e30-69d657a60a17 tempest-SnapshotDependencyTests-2100990487 None] Acquiring lock "cinder-quobyte-143796a1-9c7a-41c3-b0cd-6d105274b974" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4dadd3b4-2928-4928-9e30-69d657a60a17 tempest-SnapshotDependencyTests-2100990487 None] Lock "cinder-quobyte-143796a1-9c7a-41c3-b0cd-6d105274b974" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4dadd3b4-2928-4928-9e30-69d657a60a17 tempest-SnapshotDependencyTests-2100990487 None] Acquiring lock "cinder-quobyte-1976ff43-b823-497e-aa1f-338129990900" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4dadd3b4-2928-4928-9e30-69d657a60a17 tempest-SnapshotDependencyTests-2100990487 None] Lock "cinder-quobyte-1976ff43-b823-497e-aa1f-338129990900" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-4dadd3b4-2928-4928-9e30-69d657a60a17 tempest-SnapshotDependencyTests-2100990487 None] Deleting offline snapshot 1976ff43-b823-497e-aa1f-338129990900 of volume 143796a1-9c7a-41c3-b0cd-6d105274b974 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-4dadd3b4-2928-4928-9e30-69d657a60a17 tempest-SnapshotDependencyTests-2100990487 None] snapshot_file for this snap is: volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dcd3dd-2315-4899-878f-c00f118e9096]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4dadd3b4-2928-4928-9e30-69d657a60a17 tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:58 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbc1ed3f-b454-4f88-95b2-1bc42d838481" returned: 0 in 0.509s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.293s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f4a981-2bd6-49d6-82e0-e154a150dace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e572e9017b4f9fa5c85d3f0ce1bfa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:50Z,use_quota=True,user_id='e21a48e1d83e4430aaa5bcf647048b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Creating volume f9f4a981-2bd6-49d6-82e0-e154a150dace {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:00:58 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f9f4a981-2bd6-49d6-82e0-e154a150dace 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c91f1d-af6d-4e49-8223-5090663dfa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbc1ed3f-b454-4f88-95b2-1bc42d838481', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83adf128-289a-4631-a247-5a2d2596bc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:00:58 devstack sudo[91342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f9f4a981-2bd6-49d6-82e0-e154a150dace 1073741824 Apr 28 06:00:58 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:58 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Volume volume-dbc1ed3f-b454-4f88-95b2-1bc42d838481 (dbc1ed3f-b454-4f88-95b2-1bc42d838481): created successfully Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83adf128-289a-4631-a247-5a2d2596bc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:00:58 devstack sudo[91341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900 Apr 28 06:00:58 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Flow 'volume_create_manager' (2a23aa89-de89-4932-b20c-89aff6c164cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:00:58 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:58 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-a9837213-e26d-4ac0-af9b-5682619a6997 tempest-CreateVolumesFromSnapshotTest-841124067 None] Created volume successfully. Apr 28 06:00:59 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4dadd3b4-2928-4928-9e30-69d657a60a17 tempest-SnapshotDependencyTests-2100990487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900" returned: 0 in 0.651s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:59 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-4dadd3b4-2928-4928-9e30-69d657a60a17 tempest-SnapshotDependencyTests-2100990487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-143796a1-9c7a-41c3-b0cd-6d105274b974(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 06:00:59 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[6398fc9d-1e4b-4cef-9728-82c927a4c33b]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:00:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4dadd3b4-2928-4928-9e30-69d657a60a17 tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:59 devstack sudo[91352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974 Apr 28 06:00:59 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:00:59 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root Apr 28 06:00:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f9f4a981-2bd6-49d6-82e0-e154a150dace 1073741824" returned: 0 in 0.720s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:00:59 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f9f4a981-2bd6-49d6-82e0-e154a150dace {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:00:59 devstack sudo[91354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f9f4a981-2bd6-49d6-82e0-e154a150dace Apr 28 06:00:59 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:00 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4dadd3b4-2928-4928-9e30-69d657a60a17 tempest-SnapshotDependencyTests-2100990487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974" returned: 0 in 0.594s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4dadd3b4-2928-4928-9e30-69d657a60a17 tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:00 devstack sudo[91360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900 Apr 28 06:01:00 devstack sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:00 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f9f4a981-2bd6-49d6-82e0-e154a150dace" returned: 0 in 0.498s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.443s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1376200755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1511b86d-4418-4fe7-b975-6f1370ee713c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbd0ed1459b43edbea781a54e7f6e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:50Z,use_quota=True,user_id='dfde5fc8bc6f4d20b14807e828927e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Creating volume 1511b86d-4418-4fe7-b975-6f1370ee713c {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:01:00 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1511b86d-4418-4fe7-b975-6f1370ee713c 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87809e0-516d-4231-86bc-5d0e9f174d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9f4a981-2bd6-49d6-82e0-e154a150dace', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:01:00 devstack sudo[91362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1511b86d-4418-4fe7-b975-6f1370ee713c 1073741824 Apr 28 06:01:00 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc6ee2d-bc6a-4e3f-8d86-d062960c8e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:01:00 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Volume volume-f9f4a981-2bd6-49d6-82e0-e154a150dace (f9f4a981-2bd6-49d6-82e0-e154a150dace): created successfully Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc6ee2d-bc6a-4e3f-8d86-d062960c8e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Flow 'volume_create_manager' (c5b7c153-fb3b-4284-acb0-c48924a300b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:01:00 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-de673f92-ce7d-450b-a594-5bb617d4b3dd tempest-CinderUnicodeTest-52966463 None] Created volume successfully. Apr 28 06:01:00 devstack sudo[91360]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4dadd3b4-2928-4928-9e30-69d657a60a17 tempest-SnapshotDependencyTests-2100990487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900" returned: 0 in 0.573s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4dadd3b4-2928-4928-9e30-69d657a60a17 tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:00 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900 Apr 28 06:01:00 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:00 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1511b86d-4418-4fe7-b975-6f1370ee713c 1073741824" returned: 0 in 0.702s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:00 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1511b86d-4418-4fe7-b975-6f1370ee713c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:00 devstack sudo[91372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1511b86d-4418-4fe7-b975-6f1370ee713c Apr 28 06:01:00 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:01 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-4dadd3b4-2928-4928-9e30-69d657a60a17 tempest-SnapshotDependencyTests-2100990487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974.1976ff43-b823-497e-aa1f-338129990900" returned: 0 in 0.497s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4dadd3b4-2928-4928-9e30-69d657a60a17 tempest-SnapshotDependencyTests-2100990487 None] Lock "cinder-quobyte-1976ff43-b823-497e-aa1f-338129990900" released by "_delete_snapshot" :: held 2.428s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4dadd3b4-2928-4928-9e30-69d657a60a17 tempest-SnapshotDependencyTests-2100990487 None] Lock "cinder-quobyte-143796a1-9c7a-41c3-b0cd-6d105274b974" released by "delete_snapshot" :: held 2.452s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-4dadd3b4-2928-4928-9e30-69d657a60a17 tempest-SnapshotDependencyTests-2100990487 None] Created reservations ['847eca26-61c6-48ba-90a2-cb7babe169b2', 'c0157fe1-eb32-4024-a973-71e62d9cc135', '3aa73133-90dd-4bf9-914b-d34207f86df6', 'e2175ac8-b1c8-42e9-a4ad-9769183d31d1'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:01:01 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-4dadd3b4-2928-4928-9e30-69d657a60a17 tempest-SnapshotDependencyTests-2100990487 None] Delete snapshot completed successfully. Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-4dadd3b4-2928-4928-9e30-69d657a60a17 tempest-SnapshotDependencyTests-2100990487 None] Lock "cinder-1976ff43-b823-497e-aa1f-338129990900-delete_snapshot" released by "delete_snapshot" :: held 2.583s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:01 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1511b86d-4418-4fe7-b975-6f1370ee713c" returned: 0 in 0.557s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.459s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1023882522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66577cac-f95e-40d7-921c-dc1f370db874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbd0ed1459b43edbea781a54e7f6e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:51Z,use_quota=True,user_id='dfde5fc8bc6f4d20b14807e828927e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Creating volume 66577cac-f95e-40d7-921c-dc1f370db874 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:01:01 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-66577cac-f95e-40d7-921c-dc1f370db874 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5af00c-2265-4d13-9c58-653480105811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1511b86d-4418-4fe7-b975-6f1370ee713c', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:01:01 devstack sudo[91377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-66577cac-f95e-40d7-921c-dc1f370db874 1073741824 Apr 28 06:01:01 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f5c9ef-4d0a-4492-9c5f-ad6f6ce1b9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:01:01 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Volume volume-1511b86d-4418-4fe7-b975-6f1370ee713c (1511b86d-4418-4fe7-b975-6f1370ee713c): created successfully Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f5c9ef-4d0a-4492-9c5f-ad6f6ce1b9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Flow 'volume_create_manager' (d52ab974-a85e-455d-923a-aa8f929ad226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:01:01 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-c680ee3d-485c-4db3-a839-51c32e40c817 tempest-CreateVolumesFromSnapshotTest-841124067 None] Created volume successfully. Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81829) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Flow 'volume_create_manager' (29756bf1-4115-44c1-9420-d68d0ea8fb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608e1d8b-9e77-4423-8929-10be46ba6f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608e1d8b-9e77-4423-8929-10be46ba6f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:01:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1228336251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46494ea9-2a45-43a0-afc6-0d61b8b92552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e572e9017b4f9fa5c85d3f0ce1bfa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:01:01Z,use_quota=True,user_id='e21a48e1d83e4430aaa5bcf647048b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf150a9-f417-4ad3-9713-085cfea66069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf150a9-f417-4ad3-9713-085cfea66069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b207141-8e6b-4b52-a413-8b7f72336739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b207141-8e6b-4b52-a413-8b7f72336739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46494ea9-2a45-43a0-afc6-0d61b8b92552', 'volume_name': 'volume-46494ea9-2a45-43a0-afc6-0d61b8b92552', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb535adf-8009-4291-b72f-41d2a09608c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb535adf-8009-4291-b72f-41d2a09608c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc38919-215a-40d2-83ef-324f4c4ae7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:01:01 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Volume 46494ea9-2a45-43a0-afc6-0d61b8b92552: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46494ea9-2a45-43a0-afc6-0d61b8b92552', 'volume_size': 1} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d79904f7-f571-44b0-b6f6-101a9f9552a6 tempest-SnapshotDependencyTests-2100990487 None] Acquiring lock "cinder-143796a1-9c7a-41c3-b0cd-6d105274b974-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d79904f7-f571-44b0-b6f6-101a9f9552a6 tempest-SnapshotDependencyTests-2100990487 None] Lock "cinder-143796a1-9c7a-41c3-b0cd-6d105274b974-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d79904f7-f571-44b0-b6f6-101a9f9552a6 tempest-SnapshotDependencyTests-2100990487 None] Acquiring lock "cinder-quobyte-143796a1-9c7a-41c3-b0cd-6d105274b974" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:01 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d79904f7-f571-44b0-b6f6-101a9f9552a6 tempest-SnapshotDependencyTests-2100990487 None] Lock "cinder-quobyte-143796a1-9c7a-41c3-b0cd-6d105274b974" acquired by "delete_volume" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:02 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[775f9673-5376-418b-ba7c-d1acba78e284]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d79904f7-f571-44b0-b6f6-101a9f9552a6 tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:02 devstack sudo[91382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974 Apr 28 06:01:02 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:02 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-66577cac-f95e-40d7-921c-dc1f370db874 1073741824" returned: 0 in 0.672s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-66577cac-f95e-40d7-921c-dc1f370db874 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:02 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-66577cac-f95e-40d7-921c-dc1f370db874 Apr 28 06:01:02 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:02 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d79904f7-f571-44b0-b6f6-101a9f9552a6 tempest-SnapshotDependencyTests-2100990487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974" returned: 0 in 0.570s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d79904f7-f571-44b0-b6f6-101a9f9552a6 tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:02 devstack sudo[91390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974 Apr 28 06:01:02 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:02 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-66577cac-f95e-40d7-921c-dc1f370db874" returned: 0 in 0.462s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:02 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 06:01:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 11.432s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:02 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Cloning volume 7e01ec18-3a5f-4718-9b4b-ff55580e7d7f to volume 6d1ece01-773d-4566-a0ce-5121aeae22a7 Apr 28 06:01:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314b67fb-1bd1-4777-b911-beed93f13bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66577cac-f95e-40d7-921c-dc1f370db874', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:01:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f1ffc4-9220-4868-8d57-704065c38f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:01:02 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Volume volume-66577cac-f95e-40d7-921c-dc1f370db874 (66577cac-f95e-40d7-921c-dc1f370db874): created successfully Apr 28 06:01:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f1ffc4-9220-4868-8d57-704065c38f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:01:02 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Flow 'volume_create_manager' (0562a9f3-efa9-4aea-95ea-f2f082036826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:01:02 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Creating offline snapshot e5722dbc-d113-4b49-a903-e5c0627f36e7 of volume 7e01ec18-3a5f-4718-9b4b-ff55580e7d7f {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 06:01:02 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-1fc90024-bdba-419a-b09b-2c1718b7b51e tempest-CreateVolumesFromSnapshotTest-841124067 None] Created volume successfully. Apr 28 06:01:02 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3eaa9d-03a6-4d3b-8ba1-0f1324d93075]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:02 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:02 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f Apr 28 06:01:02 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:03 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d79904f7-f571-44b0-b6f6-101a9f9552a6 tempest-SnapshotDependencyTests-2100990487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-143796a1-9c7a-41c3-b0cd-6d105274b974" returned: 0 in 0.467s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:03 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d79904f7-f571-44b0-b6f6-101a9f9552a6 tempest-SnapshotDependencyTests-2100990487 None] Lock "cinder-quobyte-143796a1-9c7a-41c3-b0cd-6d105274b974" released by "delete_volume" :: held 1.096s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:03 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-d79904f7-f571-44b0-b6f6-101a9f9552a6 tempest-SnapshotDependencyTests-2100990487 None] Created reservations ['14ceec0b-d10c-4c0d-a50f-3cb4640f2e49', '52112773-5ca7-4d42-b445-836241ff132b', '80adbcf6-bd73-4d67-aeea-a347c1c1a232', 'fa228d49-c1eb-4490-9dd8-02eca7618dad'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:01:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d79904f7-f571-44b0-b6f6-101a9f9552a6 tempest-SnapshotDependencyTests-2100990487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:01:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d79904f7-f571-44b0-b6f6-101a9f9552a6 tempest-SnapshotDependencyTests-2100990487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:03 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d79904f7-f571-44b0-b6f6-101a9f9552a6 tempest-SnapshotDependencyTests-2100990487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:01:03 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-d79904f7-f571-44b0-b6f6-101a9f9552a6 tempest-SnapshotDependencyTests-2100990487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:01:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-d79904f7-f571-44b0-b6f6-101a9f9552a6 tempest-SnapshotDependencyTests-2100990487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d79904f7-f571-44b0-b6f6-101a9f9552a6 tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:03 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:01:03 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:03 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f" returned: 0 in 0.568s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:03 devstack sudo[91400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7 1G Apr 28 06:01:03 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:03 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-d79904f7-f571-44b0-b6f6-101a9f9552a6 tempest-SnapshotDependencyTests-2100990487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.479s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:03 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-d79904f7-f571-44b0-b6f6-101a9f9552a6 tempest-SnapshotDependencyTests-2100990487 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:01:03 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-d79904f7-f571-44b0-b6f6-101a9f9552a6 tempest-SnapshotDependencyTests-2100990487 None] Deleted volume successfully. Apr 28 06:01:03 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-d79904f7-f571-44b0-b6f6-101a9f9552a6 tempest-SnapshotDependencyTests-2100990487 None] Lock "cinder-143796a1-9c7a-41c3-b0cd-6d105274b974-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:03 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7 1G" returned: 0 in 0.637s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:03 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:03 devstack sudo[91406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7 Apr 28 06:01:03 devstack sudo[91406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e558fcea-2f0d-46c9-b3e1-6693a8b3b9da tempest-SnapshotDependencyTests-2100990487 None] Acquiring lock "cinder-88027f3b-38b7-42a8-8a97-0d55ce7d6d69-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e558fcea-2f0d-46c9-b3e1-6693a8b3b9da tempest-SnapshotDependencyTests-2100990487 None] Lock "cinder-88027f3b-38b7-42a8-8a97-0d55ce7d6d69-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e558fcea-2f0d-46c9-b3e1-6693a8b3b9da tempest-SnapshotDependencyTests-2100990487 None] Acquiring lock "cinder-quobyte-88027f3b-38b7-42a8-8a97-0d55ce7d6d69" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:04 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e558fcea-2f0d-46c9-b3e1-6693a8b3b9da tempest-SnapshotDependencyTests-2100990487 None] Lock "cinder-quobyte-88027f3b-38b7-42a8-8a97-0d55ce7d6d69" acquired by "delete_volume" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:04 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e41ec09-4edd-4dd9-b0c2-2a715c63eda2]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e558fcea-2f0d-46c9-b3e1-6693a8b3b9da tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-88027f3b-38b7-42a8-8a97-0d55ce7d6d69 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:04 devstack sudo[91408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-88027f3b-38b7-42a8-8a97-0d55ce7d6d69 Apr 28 06:01:04 devstack sudo[91408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:04 devstack sudo[91406]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7" returned: 0 in 0.537s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:04 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7 is being set with open permissions: ugo+rw Apr 28 06:01:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:04 devstack sudo[91413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7 Apr 28 06:01:04 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:04 devstack sudo[91408]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e558fcea-2f0d-46c9-b3e1-6693a8b3b9da tempest-SnapshotDependencyTests-2100990487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-88027f3b-38b7-42a8-8a97-0d55ce7d6d69" returned: 0 in 0.545s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e558fcea-2f0d-46c9-b3e1-6693a8b3b9da tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-88027f3b-38b7-42a8-8a97-0d55ce7d6d69 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:04 devstack sudo[91418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-88027f3b-38b7-42a8-8a97-0d55ce7d6d69 Apr 28 06:01:04 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:04 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7" returned: 0 in 0.457s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:04 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:04 devstack sudo[91421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.info Apr 28 06:01:04 devstack sudo[91421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:05 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e558fcea-2f0d-46c9-b3e1-6693a8b3b9da tempest-SnapshotDependencyTests-2100990487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-88027f3b-38b7-42a8-8a97-0d55ce7d6d69" returned: 0 in 0.460s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e558fcea-2f0d-46c9-b3e1-6693a8b3b9da tempest-SnapshotDependencyTests-2100990487 None] Lock "cinder-quobyte-88027f3b-38b7-42a8-8a97-0d55ce7d6d69" released by "delete_volume" :: held 1.046s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:05 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-e558fcea-2f0d-46c9-b3e1-6693a8b3b9da tempest-SnapshotDependencyTests-2100990487 None] Created reservations ['fc69eab5-680c-4c7c-b768-fb78fe5557c2', 'f5d28f0f-2409-4720-9c70-4b24178aecb3', 'f3fa2d1a-a8fb-43fd-b848-fe108731ce88', '171c1395-8cba-47f7-894f-7ddb5149d1df'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:01:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e558fcea-2f0d-46c9-b3e1-6693a8b3b9da tempest-SnapshotDependencyTests-2100990487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:01:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e558fcea-2f0d-46c9-b3e1-6693a8b3b9da tempest-SnapshotDependencyTests-2100990487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e558fcea-2f0d-46c9-b3e1-6693a8b3b9da tempest-SnapshotDependencyTests-2100990487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:01:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-e558fcea-2f0d-46c9-b3e1-6693a8b3b9da tempest-SnapshotDependencyTests-2100990487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:01:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-e558fcea-2f0d-46c9-b3e1-6693a8b3b9da tempest-SnapshotDependencyTests-2100990487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e558fcea-2f0d-46c9-b3e1-6693a8b3b9da tempest-SnapshotDependencyTests-2100990487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:05 devstack sudo[91425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:01:05 devstack sudo[91425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:05 devstack sudo[91421]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.info" returned: 0 in 0.497s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:05 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.info is being set with open permissions: ugo+rw Apr 28 06:01:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:05 devstack sudo[91427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.info Apr 28 06:01:05 devstack sudo[91427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:05 devstack sudo[91425]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-e558fcea-2f0d-46c9-b3e1-6693a8b3b9da tempest-SnapshotDependencyTests-2100990487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.457s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:05 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-e558fcea-2f0d-46c9-b3e1-6693a8b3b9da tempest-SnapshotDependencyTests-2100990487 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:01:05 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-e558fcea-2f0d-46c9-b3e1-6693a8b3b9da tempest-SnapshotDependencyTests-2100990487 None] Deleted volume successfully. Apr 28 06:01:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-e558fcea-2f0d-46c9-b3e1-6693a8b3b9da tempest-SnapshotDependencyTests-2100990487 None] Lock "cinder-88027f3b-38b7-42a8-8a97-0d55ce7d6d69-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:05 devstack sudo[91427]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:05 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.info" returned: 0 in 0.511s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Acquiring lock "cinder-quobyte-6d1ece01-773d-4566-a0ce-5121aeae22a7" by "_copy_volume_from_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:05 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Lock "cinder-quobyte-6d1ece01-773d-4566-a0ce-5121aeae22a7" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:05 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] snapshot: e5722dbc-d113-4b49-a903-e5c0627f36e7, volume: 6d1ece01-773d-4566-a0ce-5121aeae22a7, {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 28 06:01:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:01:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:01:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:01:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:06 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c337ef-9df0-41a9-ba0a-7d988c26d886]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:06 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7 Apr 28 06:01:06 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:06 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7" returned: 0 in 0.560s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 06:01:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] will copy from snapshot at /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 28 06:01:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Creating direct copy from snapshot {{(pid=81829) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 28 06:01:06 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[b969a62d-d37d-41f4-b4e6-c8edf7909f35]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:06 devstack sudo[91436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f Apr 28 06:01:06 devstack sudo[91436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:06 devstack cinder-volume[81829]: DEBUG oslo_service.periodic_task [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81829) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 28 06:01:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:01:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:01:06 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:01:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:06 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:06 devstack sudo[91438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:01:06 devstack sudo[91438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:07 devstack sudo[91436]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f" returned: 0 in 0.612s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:07 devstack cinder-volume[81829]: DEBUG cinder.utils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Path /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6d1ece01-773d-4566-a0ce-5121aeae22a7 not found in is_blk_device check {{(pid=81829) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 28 06:01:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6d1ece01-773d-4566-a0ce-5121aeae22a7 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:07 devstack sudo[91444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6d1ece01-773d-4566-a0ce-5121aeae22a7 Apr 28 06:01:07 devstack sudo[91444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:07 devstack sudo[91438]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:07 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.558s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:07 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-1afde780-29b6-4a47-a2be-a260ac634116 None None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:01:12 devstack sudo[91444]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6d1ece01-773d-4566-a0ce-5121aeae22a7" returned: 0 in 5.441s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:12 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0962ce7-3f9d-4974-936a-5ffed5aeca73]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:12 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:12 devstack sudo[91462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f Apr 28 06:01:12 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:13 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f" returned: 0 in 0.690s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:13 devstack cinder-volume[81829]: DEBUG cinder.image.image_utils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Image conversion details: src /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f, size 1024.00 MB, duration 5.44 sec, destination /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6d1ece01-773d-4566-a0ce-5121aeae22a7 {{(pid=81829) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 28 06:01:13 devstack cinder-volume[81829]: INFO cinder.image.image_utils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Converted 1024.00 MB image at 188.13 MB/s Apr 28 06:01:13 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6d1ece01-773d-4566-a0ce-5121aeae22a7 is being set with open permissions: ugo+rw Apr 28 06:01:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6d1ece01-773d-4566-a0ce-5121aeae22a7 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:13 devstack sudo[91468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6d1ece01-773d-4566-a0ce-5121aeae22a7 Apr 28 06:01:13 devstack sudo[91468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:13 devstack sudo[91468]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6d1ece01-773d-4566-a0ce-5121aeae22a7" returned: 0 in 0.505s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:13 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Lock "cinder-quobyte-6d1ece01-773d-4566-a0ce-5121aeae22a7" released by "_copy_volume_from_snapshot" :: held 7.887s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:13 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Acquiring lock "cinder-quobyte-e5722dbc-d113-4b49-a903-e5c0627f36e7" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:13 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Lock "cinder-quobyte-e5722dbc-d113-4b49-a903-e5c0627f36e7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:13 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Deleting offline snapshot e5722dbc-d113-4b49-a903-e5c0627f36e7 of volume 7e01ec18-3a5f-4718-9b4b-ff55580e7d7f {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 06:01:13 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] snapshot_file for this snap is: volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 06:01:13 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[36700eb1-4c40-49f7-99b2-8ada4fc7331d]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:13 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:14 devstack sudo[91471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7 Apr 28 06:01:14 devstack sudo[91471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:14 devstack sudo[91471]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7" returned: 0 in 0.524s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:14 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 06:01:14 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c6df45-c341-4d07-acde-b29051aa68fd]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:14 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:14 devstack sudo[91476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f Apr 28 06:01:14 devstack sudo[91476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:15 devstack sudo[91476]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f" returned: 0 in 0.560s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:15 devstack sudo[91481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7 Apr 28 06:01:15 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:15 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:UPDATE=93,cinder:DELETE=9,cinder:SELECT=76,cinder:INSERT=23 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 06:01:15 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7" returned: 0 in 0.594s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:15 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:15 devstack sudo[91487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7 Apr 28 06:01:15 devstack sudo[91487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:16 devstack sudo[91487]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f.e5722dbc-d113-4b49-a903-e5c0627f36e7" returned: 0 in 0.503s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:16 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Lock "cinder-quobyte-e5722dbc-d113-4b49-a903-e5c0627f36e7" released by "_delete_snapshot" :: held 2.332s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.639s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.970s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-590246068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f3da6b0-f84c-4432-9c86-ae1b40c7d12e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbd0ed1459b43edbea781a54e7f6e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:51Z,use_quota=True,user_id='dfde5fc8bc6f4d20b14807e828927e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 06:01:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Creating volume 1f3da6b0-f84c-4432-9c86-ae1b40c7d12e {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 06:01:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:01:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:01:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:01:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:16 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:01:16 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 06:01:16 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f3da6b0-f84c-4432-9c86-ae1b40c7d12e 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:16 devstack sudo[91490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f3da6b0-f84c-4432-9c86-ae1b40c7d12e 1073741824 Apr 28 06:01:16 devstack sudo[91490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d75aa3c-aa88-4751-9981-cd28be7e7e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d1ece01-773d-4566-a0ce-5121aeae22a7', 'volume_size': 1, 'source_volid': '7e01ec18-3a5f-4718-9b4b-ff55580e7d7f', 'source_volstatus': 'available'}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:01:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49005aee-77bc-4d64-9a6d-c785f2a789d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:01:16 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Volume volume-6d1ece01-773d-4566-a0ce-5121aeae22a7 (6d1ece01-773d-4566-a0ce-5121aeae22a7): created successfully Apr 28 06:01:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49005aee-77bc-4d64-9a6d-c785f2a789d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:01:16 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Flow 'volume_create_manager' (ca5dfc38-d4fa-4fb7-9026-3c5ea450592c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:01:16 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-0b8e0f91-3996-4c28-9245-b3e8784ef0c4 tempest-VolumeDependencyTests-41616770 None] Created volume successfully. Apr 28 06:01:16 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7e73cdf6-d8aa-4f28-a819-492e7eeea2af tempest-VolumeDependencyTests-41616770 None] Acquiring lock "cinder-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:16 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7e73cdf6-d8aa-4f28-a819-492e7eeea2af tempest-VolumeDependencyTests-41616770 None] Lock "cinder-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:16 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7e73cdf6-d8aa-4f28-a819-492e7eeea2af tempest-VolumeDependencyTests-41616770 None] Acquiring lock "cinder-quobyte-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:16 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7e73cdf6-d8aa-4f28-a819-492e7eeea2af tempest-VolumeDependencyTests-41616770 None] Lock "cinder-quobyte-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f" acquired by "delete_volume" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef38e0e-161b-4674-9b30-63b6adc5b033]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7e73cdf6-d8aa-4f28-a819-492e7eeea2af tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:17 devstack sudo[91490]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f3da6b0-f84c-4432-9c86-ae1b40c7d12e 1073741824" returned: 0 in 0.804s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:17 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f Apr 28 06:01:17 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f3da6b0-f84c-4432-9c86-ae1b40c7d12e {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:17 devstack sudo[91497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f3da6b0-f84c-4432-9c86-ae1b40c7d12e Apr 28 06:01:17 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:17 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7e73cdf6-d8aa-4f28-a819-492e7eeea2af tempest-VolumeDependencyTests-41616770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f" returned: 0 in 0.523s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7e73cdf6-d8aa-4f28-a819-492e7eeea2af tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:17 devstack sudo[91503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f Apr 28 06:01:17 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:17 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f3da6b0-f84c-4432-9c86-ae1b40c7d12e" returned: 0 in 0.503s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.118s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1958262074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85722779-e710-45ac-a1b2-468dfb3b204d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbd0ed1459b43edbea781a54e7f6e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:00:51Z,use_quota=True,user_id='dfde5fc8bc6f4d20b14807e828927e06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Creating volume 85722779-e710-45ac-a1b2-468dfb3b204d {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:01:17 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-85722779-e710-45ac-a1b2-468dfb3b204d 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:17 devstack sudo[91505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-85722779-e710-45ac-a1b2-468dfb3b204d 1073741824 Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e774f3-3938-4ead-bf26-77f7ecfc206c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f3da6b0-f84c-4432-9c86-ae1b40c7d12e', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:01:17 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da09cff2-1e64-4842-bd48-64d25551f9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:01:17 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Volume volume-1f3da6b0-f84c-4432-9c86-ae1b40c7d12e (1f3da6b0-f84c-4432-9c86-ae1b40c7d12e): created successfully Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da09cff2-1e64-4842-bd48-64d25551f9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Flow 'volume_create_manager' (92ca0473-f7c8-4bef-9d4f-e500453bb742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:01:17 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-a2769db3-5f2e-4448-a69a-96ff2118f6c2 tempest-CreateVolumesFromSnapshotTest-841124067 None] Created volume successfully. Apr 28 06:01:17 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:17 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7e73cdf6-d8aa-4f28-a819-492e7eeea2af tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f" returned: 0 in 0.436s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7e73cdf6-d8aa-4f28-a819-492e7eeea2af tempest-VolumeDependencyTests-41616770 None] Lock "cinder-quobyte-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f" released by "delete_volume" :: held 1.021s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-7e73cdf6-d8aa-4f28-a819-492e7eeea2af tempest-VolumeDependencyTests-41616770 None] Created reservations ['75e2ed8d-5039-4f4f-8796-0793d489d122', '96db0a9d-71e9-4e04-8c37-7b1ac8058706', '5faf54ba-17c5-437e-8f83-cef772354a93', 'fce06847-aee0-4b04-877b-b61735f58eac'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7e73cdf6-d8aa-4f28-a819-492e7eeea2af tempest-VolumeDependencyTests-41616770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7e73cdf6-d8aa-4f28-a819-492e7eeea2af tempest-VolumeDependencyTests-41616770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7e73cdf6-d8aa-4f28-a819-492e7eeea2af tempest-VolumeDependencyTests-41616770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-7e73cdf6-d8aa-4f28-a819-492e7eeea2af tempest-VolumeDependencyTests-41616770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-7e73cdf6-d8aa-4f28-a819-492e7eeea2af tempest-VolumeDependencyTests-41616770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7e73cdf6-d8aa-4f28-a819-492e7eeea2af tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:18 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:01:18 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:18 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-85722779-e710-45ac-a1b2-468dfb3b204d 1073741824" returned: 0 in 0.654s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-85722779-e710-45ac-a1b2-468dfb3b204d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:18 devstack sudo[91513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-85722779-e710-45ac-a1b2-468dfb3b204d Apr 28 06:01:18 devstack sudo[91513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:18 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-7e73cdf6-d8aa-4f28-a819-492e7eeea2af tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.479s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-7e73cdf6-d8aa-4f28-a819-492e7eeea2af tempest-VolumeDependencyTests-41616770 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:01:18 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-7e73cdf6-d8aa-4f28-a819-492e7eeea2af tempest-VolumeDependencyTests-41616770 None] Deleted volume successfully. Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-7e73cdf6-d8aa-4f28-a819-492e7eeea2af tempest-VolumeDependencyTests-41616770 None] Lock "cinder-7e01ec18-3a5f-4718-9b4b-ff55580e7d7f-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:18 devstack sudo[91513]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-85722779-e710-45ac-a1b2-468dfb3b204d" returned: 0 in 0.457s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.168s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-28T04:01:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1228336251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46494ea9-2a45-43a0-afc6-0d61b8b92552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e572e9017b4f9fa5c85d3f0ce1bfa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T04:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T04:01:01Z,use_quota=True,user_id='e21a48e1d83e4430aaa5bcf647048b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c14c26f-2835-4e98-afed-1ed97b23420e),volume_type_id=5c14c26f-2835-4e98-afed-1ed97b23420e)}" {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Creating volume 46494ea9-2a45-43a0-afc6-0d61b8b92552 {{(pid=81829) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Selected osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 as target Quobyte volume. {{(pid=81829) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 28 06:01:18 devstack cinder-volume[81829]: INFO cinder.volume.drivers.remotefs [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] casted to osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381 Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552 1073741824 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76b0411-8dcd-43e2-88b0-fb2084278f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85722779-e710-45ac-a1b2-468dfb3b204d', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (395f21ad-9a69-4243-8461-5b235591561b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:01:18 devstack sudo[91517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552 1073741824 Apr 28 06:01:18 devstack sudo[91517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:18 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Volume volume-85722779-e710-45ac-a1b2-468dfb3b204d (85722779-e710-45ac-a1b2-468dfb3b204d): created successfully Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (395f21ad-9a69-4243-8461-5b235591561b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:01:18 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Flow 'volume_create_manager' (ce5b4cf5-c59d-4a34-8de5-058b00350dfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:01:18 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-35bbb7b0-311b-4170-93df-a4d9d1198ac6 tempest-CreateVolumesFromSnapshotTest-841124067 None] Created volume successfully. Apr 28 06:01:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ae363da5-ccb6-4d5b-a3b2-b27906daa04e tempest-VolumeDependencyTests-41616770 None] Acquiring lock "cinder-6d1ece01-773d-4566-a0ce-5121aeae22a7-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ae363da5-ccb6-4d5b-a3b2-b27906daa04e tempest-VolumeDependencyTests-41616770 None] Lock "cinder-6d1ece01-773d-4566-a0ce-5121aeae22a7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ae363da5-ccb6-4d5b-a3b2-b27906daa04e tempest-VolumeDependencyTests-41616770 None] Acquiring lock "cinder-quobyte-6d1ece01-773d-4566-a0ce-5121aeae22a7" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ae363da5-ccb6-4d5b-a3b2-b27906daa04e tempest-VolumeDependencyTests-41616770 None] Lock "cinder-quobyte-6d1ece01-773d-4566-a0ce-5121aeae22a7" acquired by "delete_volume" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:19 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba64a8c-6a93-468f-86ab-b204e56cfa2e]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ae363da5-ccb6-4d5b-a3b2-b27906daa04e tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6d1ece01-773d-4566-a0ce-5121aeae22a7 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:19 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6d1ece01-773d-4566-a0ce-5121aeae22a7 Apr 28 06:01:19 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:19 devstack sudo[91517]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552 1073741824" returned: 0 in 0.639s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:19 devstack sudo[91524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552 Apr 28 06:01:19 devstack sudo[91524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b7b3b560-abb0-4063-aa8f-02aeba7a9446 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "cinder-85722779-e710-45ac-a1b2-468dfb3b204d-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b7b3b560-abb0-4063-aa8f-02aeba7a9446 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-85722779-e710-45ac-a1b2-468dfb3b204d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b7b3b560-abb0-4063-aa8f-02aeba7a9446 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "cinder-quobyte-85722779-e710-45ac-a1b2-468dfb3b204d" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:19 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b7b3b560-abb0-4063-aa8f-02aeba7a9446 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-quobyte-85722779-e710-45ac-a1b2-468dfb3b204d" acquired by "delete_volume" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:19 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[d478c399-5c8e-40c9-8641-5cb4cc394399]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b7b3b560-abb0-4063-aa8f-02aeba7a9446 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-85722779-e710-45ac-a1b2-468dfb3b204d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:19 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ae363da5-ccb6-4d5b-a3b2-b27906daa04e tempest-VolumeDependencyTests-41616770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6d1ece01-773d-4566-a0ce-5121aeae22a7" returned: 0 in 0.592s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ae363da5-ccb6-4d5b-a3b2-b27906daa04e tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6d1ece01-773d-4566-a0ce-5121aeae22a7 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:19 devstack sudo[91529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-85722779-e710-45ac-a1b2-468dfb3b204d Apr 28 06:01:19 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:19 devstack sudo[91530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6d1ece01-773d-4566-a0ce-5121aeae22a7 Apr 28 06:01:19 devstack sudo[91530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:19 devstack sudo[91524]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552" returned: 0 in 0.496s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:19 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'} {{(pid=81829) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Apr 28 06:01:19 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc38919-215a-40d2-83ef-324f4c4ae7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46494ea9-2a45-43a0-afc6-0d61b8b92552', 'volume_size': 1}' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:01:19 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5a4510-c5e9-4450-93f2-6f86518bc332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 28 06:01:20 devstack cinder-volume[81829]: INFO cinder.volume.flows.manager.create_volume [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Volume volume-46494ea9-2a45-43a0-afc6-0d61b8b92552 (46494ea9-2a45-43a0-afc6-0d61b8b92552): created successfully Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5a4510-c5e9-4450-93f2-6f86518bc332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81829) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG cinder.volume.manager [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Flow 'volume_create_manager' (29756bf1-4115-44c1-9420-d68d0ea8fb2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81829) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 28 06:01:20 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-a1c03fdf-197f-4731-a8f9-a73243695bd2 tempest-CinderUnicodeTest-52966463 None] Created volume successfully. Apr 28 06:01:20 devstack sudo[91530]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ae363da5-ccb6-4d5b-a3b2-b27906daa04e tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-6d1ece01-773d-4566-a0ce-5121aeae22a7" returned: 0 in 0.475s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ae363da5-ccb6-4d5b-a3b2-b27906daa04e tempest-VolumeDependencyTests-41616770 None] Lock "cinder-quobyte-6d1ece01-773d-4566-a0ce-5121aeae22a7" released by "delete_volume" :: held 1.108s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-ae363da5-ccb6-4d5b-a3b2-b27906daa04e tempest-VolumeDependencyTests-41616770 None] Created reservations ['b7babdba-49a9-4dc8-8d69-b970a721bd2b', 'c943135f-730f-489d-832a-66b865dad8b2', '2d438f38-c91b-47f8-bdeb-3974bc005f55', '31e99be0-a194-46bb-9a00-7cb48f5bbef2'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:01:20 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b7b3b560-abb0-4063-aa8f-02aeba7a9446 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-85722779-e710-45ac-a1b2-468dfb3b204d" returned: 0 in 0.578s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b7b3b560-abb0-4063-aa8f-02aeba7a9446 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-85722779-e710-45ac-a1b2-468dfb3b204d {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:20 devstack sudo[91538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-85722779-e710-45ac-a1b2-468dfb3b204d Apr 28 06:01:20 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ae363da5-ccb6-4d5b-a3b2-b27906daa04e tempest-VolumeDependencyTests-41616770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ae363da5-ccb6-4d5b-a3b2-b27906daa04e tempest-VolumeDependencyTests-41616770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ae363da5-ccb6-4d5b-a3b2-b27906daa04e tempest-VolumeDependencyTests-41616770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-ae363da5-ccb6-4d5b-a3b2-b27906daa04e tempest-VolumeDependencyTests-41616770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-ae363da5-ccb6-4d5b-a3b2-b27906daa04e tempest-VolumeDependencyTests-41616770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ae363da5-ccb6-4d5b-a3b2-b27906daa04e tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:20 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:01:20 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:20 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b7b3b560-abb0-4063-aa8f-02aeba7a9446 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-85722779-e710-45ac-a1b2-468dfb3b204d" returned: 0 in 0.467s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b7b3b560-abb0-4063-aa8f-02aeba7a9446 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-quobyte-85722779-e710-45ac-a1b2-468dfb3b204d" released by "delete_volume" :: held 1.082s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:20 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-ae363da5-ccb6-4d5b-a3b2-b27906daa04e tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.465s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-ae363da5-ccb6-4d5b-a3b2-b27906daa04e tempest-VolumeDependencyTests-41616770 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-b7b3b560-abb0-4063-aa8f-02aeba7a9446 tempest-CreateVolumesFromSnapshotTest-841124067 None] Created reservations ['4afb5867-f274-442b-8514-abc5da711456', 'b33c9fa7-6e39-4a13-aa38-70c5a5ff5e6f', 'e36fcc69-ef65-436b-962d-c949ef59236f', '790228f2-9259-4e99-bb9c-bdafe2ef0b96'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:01:20 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-ae363da5-ccb6-4d5b-a3b2-b27906daa04e tempest-VolumeDependencyTests-41616770 None] Deleted volume successfully. Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-ae363da5-ccb6-4d5b-a3b2-b27906daa04e tempest-VolumeDependencyTests-41616770 None] Lock "cinder-6d1ece01-773d-4566-a0ce-5121aeae22a7-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b7b3b560-abb0-4063-aa8f-02aeba7a9446 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b7b3b560-abb0-4063-aa8f-02aeba7a9446 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b7b3b560-abb0-4063-aa8f-02aeba7a9446 tempest-CreateVolumesFromSnapshotTest-841124067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b7b3b560-abb0-4063-aa8f-02aeba7a9446 tempest-CreateVolumesFromSnapshotTest-841124067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b7b3b560-abb0-4063-aa8f-02aeba7a9446 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:20 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b7b3b560-abb0-4063-aa8f-02aeba7a9446 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:21 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:01:21 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-879e2c5c-b594-4634-8907-6832b99c5e66 tempest-CinderUnicodeTest-52966463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:01:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-879e2c5c-b594-4634-8907-6832b99c5e66 tempest-CinderUnicodeTest-52966463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:21 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-879e2c5c-b594-4634-8907-6832b99c5e66 tempest-CinderUnicodeTest-52966463 None] Creating offline snapshot 587da008-7be3-4328-94be-cc931ada1cb0 of volume 46494ea9-2a45-43a0-afc6-0d61b8b92552 {{(pid=81829) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 28 06:01:21 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f1d677-c680-4911-92d9-fe2f7067d9ef]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-879e2c5c-b594-4634-8907-6832b99c5e66 tempest-CinderUnicodeTest-52966463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:21 devstack sudo[91547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552 Apr 28 06:01:21 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a9ca8155-f95a-4d1f-870a-cb08497059f7 tempest-VolumeDependencyTests-41616770 None] Acquiring lock "cinder-3f57a65b-9b19-4157-8f57-986827a37b96-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a9ca8155-f95a-4d1f-870a-cb08497059f7 tempest-VolumeDependencyTests-41616770 None] Lock "cinder-3f57a65b-9b19-4157-8f57-986827a37b96-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a9ca8155-f95a-4d1f-870a-cb08497059f7 tempest-VolumeDependencyTests-41616770 None] Acquiring lock "cinder-quobyte-3f57a65b-9b19-4157-8f57-986827a37b96" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:21 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a9ca8155-f95a-4d1f-870a-cb08497059f7 tempest-VolumeDependencyTests-41616770 None] Lock "cinder-quobyte-3f57a65b-9b19-4157-8f57-986827a37b96" acquired by "delete_volume" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b7b3b560-abb0-4063-aa8f-02aeba7a9446 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.508s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:21 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-b7b3b560-abb0-4063-aa8f-02aeba7a9446 tempest-CreateVolumesFromSnapshotTest-841124067 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:01:21 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-b7b3b560-abb0-4063-aa8f-02aeba7a9446 tempest-CreateVolumesFromSnapshotTest-841124067 None] Deleted volume successfully. Apr 28 06:01:21 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[245815ab-9f49-40bb-9cad-e60d124199b9]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a9ca8155-f95a-4d1f-870a-cb08497059f7 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f57a65b-9b19-4157-8f57-986827a37b96 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b7b3b560-abb0-4063-aa8f-02aeba7a9446 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-85722779-e710-45ac-a1b2-468dfb3b204d-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:21 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f57a65b-9b19-4157-8f57-986827a37b96 Apr 28 06:01:21 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:21 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-879e2c5c-b594-4634-8907-6832b99c5e66 tempest-CinderUnicodeTest-52966463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552" returned: 0 in 0.581s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:21 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-879e2c5c-b594-4634-8907-6832b99c5e66 tempest-CinderUnicodeTest-52966463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.587da008-7be3-4328-94be-cc931ada1cb0 1G {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:21 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.587da008-7be3-4328-94be-cc931ada1cb0 1G Apr 28 06:01:21 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-dd776aa4-0003-4b65-8a2d-8f086f171bb8 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "cinder-1f3da6b0-f84c-4432-9c86-ae1b40c7d12e-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-dd776aa4-0003-4b65-8a2d-8f086f171bb8 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-1f3da6b0-f84c-4432-9c86-ae1b40c7d12e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-dd776aa4-0003-4b65-8a2d-8f086f171bb8 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "cinder-quobyte-1f3da6b0-f84c-4432-9c86-ae1b40c7d12e" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:21 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-dd776aa4-0003-4b65-8a2d-8f086f171bb8 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-quobyte-1f3da6b0-f84c-4432-9c86-ae1b40c7d12e" acquired by "delete_volume" :: waited 0.020s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:22 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a83ed8-edfb-44e5-99be-d9721ae319f6]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dd776aa4-0003-4b65-8a2d-8f086f171bb8 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f3da6b0-f84c-4432-9c86-ae1b40c7d12e {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:22 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a9ca8155-f95a-4d1f-870a-cb08497059f7 tempest-VolumeDependencyTests-41616770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f57a65b-9b19-4157-8f57-986827a37b96" returned: 0 in 0.579s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a9ca8155-f95a-4d1f-870a-cb08497059f7 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f57a65b-9b19-4157-8f57-986827a37b96 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:22 devstack sudo[91560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f3da6b0-f84c-4432-9c86-ae1b40c7d12e Apr 28 06:01:22 devstack sudo[91560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:22 devstack sudo[91561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f57a65b-9b19-4157-8f57-986827a37b96 Apr 28 06:01:22 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:22 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-879e2c5c-b594-4634-8907-6832b99c5e66 tempest-CinderUnicodeTest-52966463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.587da008-7be3-4328-94be-cc931ada1cb0 1G" returned: 0 in 0.603s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-879e2c5c-b594-4634-8907-6832b99c5e66 tempest-CinderUnicodeTest-52966463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46494ea9-2a45-43a0-afc6-0d61b8b92552 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.587da008-7be3-4328-94be-cc931ada1cb0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:22 devstack sudo[91570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46494ea9-2a45-43a0-afc6-0d61b8b92552 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.587da008-7be3-4328-94be-cc931ada1cb0 Apr 28 06:01:22 devstack sudo[91570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:22 devstack sudo[91560]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dd776aa4-0003-4b65-8a2d-8f086f171bb8 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f3da6b0-f84c-4432-9c86-ae1b40c7d12e" returned: 0 in 0.573s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dd776aa4-0003-4b65-8a2d-8f086f171bb8 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f3da6b0-f84c-4432-9c86-ae1b40c7d12e {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:22 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a9ca8155-f95a-4d1f-870a-cb08497059f7 tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-3f57a65b-9b19-4157-8f57-986827a37b96" returned: 0 in 0.518s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:22 devstack sudo[91573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f3da6b0-f84c-4432-9c86-ae1b40c7d12e Apr 28 06:01:22 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a9ca8155-f95a-4d1f-870a-cb08497059f7 tempest-VolumeDependencyTests-41616770 None] Lock "cinder-quobyte-3f57a65b-9b19-4157-8f57-986827a37b96" released by "delete_volume" :: held 1.143s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:22 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:22 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-a9ca8155-f95a-4d1f-870a-cb08497059f7 tempest-VolumeDependencyTests-41616770 None] Created reservations ['edfd262d-fa02-4476-b3ac-c5aa39121f45', '0873f58c-a857-4d69-a13b-ac9b3d1b4b08', 'cce1a8bd-e7a9-4db8-8878-f49c001c064d', 'cac3fa3f-18bd-467d-b344-4d3767ddcba1'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:01:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a9ca8155-f95a-4d1f-870a-cb08497059f7 tempest-VolumeDependencyTests-41616770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:01:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a9ca8155-f95a-4d1f-870a-cb08497059f7 tempest-VolumeDependencyTests-41616770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a9ca8155-f95a-4d1f-870a-cb08497059f7 tempest-VolumeDependencyTests-41616770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:01:22 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a9ca8155-f95a-4d1f-870a-cb08497059f7 tempest-VolumeDependencyTests-41616770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:01:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a9ca8155-f95a-4d1f-870a-cb08497059f7 tempest-VolumeDependencyTests-41616770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a9ca8155-f95a-4d1f-870a-cb08497059f7 tempest-VolumeDependencyTests-41616770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:22 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:01:22 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:22 devstack sudo[91570]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-879e2c5c-b594-4634-8907-6832b99c5e66 tempest-CinderUnicodeTest-52966463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46494ea9-2a45-43a0-afc6-0d61b8b92552 -F qcow2 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.587da008-7be3-4328-94be-cc931ada1cb0" returned: 0 in 0.511s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:22 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-879e2c5c-b594-4634-8907-6832b99c5e66 tempest-CinderUnicodeTest-52966463 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.587da008-7be3-4328-94be-cc931ada1cb0 is being set with open permissions: ugo+rw Apr 28 06:01:22 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-879e2c5c-b594-4634-8907-6832b99c5e66 tempest-CinderUnicodeTest-52966463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.587da008-7be3-4328-94be-cc931ada1cb0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:23 devstack sudo[91594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.587da008-7be3-4328-94be-cc931ada1cb0 Apr 28 06:01:23 devstack sudo[91594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:23 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dd776aa4-0003-4b65-8a2d-8f086f171bb8 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1f3da6b0-f84c-4432-9c86-ae1b40c7d12e" returned: 0 in 0.514s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-dd776aa4-0003-4b65-8a2d-8f086f171bb8 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-quobyte-1f3da6b0-f84c-4432-9c86-ae1b40c7d12e" released by "delete_volume" :: held 1.141s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:23 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-dd776aa4-0003-4b65-8a2d-8f086f171bb8 tempest-CreateVolumesFromSnapshotTest-841124067 None] Created reservations ['926463e1-5d13-4f55-bce5-2cfe31b3da71', '0a827d38-37bb-4109-bcb5-7c4ae0e8e3fa', '8a29d8ba-d033-4224-a62a-3b2636256c79', '189941e9-bd0c-4ad1-b934-68aabd27337e'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:01:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dd776aa4-0003-4b65-8a2d-8f086f171bb8 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:01:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dd776aa4-0003-4b65-8a2d-8f086f171bb8 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:23 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dd776aa4-0003-4b65-8a2d-8f086f171bb8 tempest-CreateVolumesFromSnapshotTest-841124067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:01:23 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-dd776aa4-0003-4b65-8a2d-8f086f171bb8 tempest-CreateVolumesFromSnapshotTest-841124067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:01:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-dd776aa4-0003-4b65-8a2d-8f086f171bb8 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dd776aa4-0003-4b65-8a2d-8f086f171bb8 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:23 devstack sudo[91617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:01:23 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:23 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a9ca8155-f95a-4d1f-870a-cb08497059f7 tempest-VolumeDependencyTests-41616770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.578s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:23 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-a9ca8155-f95a-4d1f-870a-cb08497059f7 tempest-VolumeDependencyTests-41616770 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:01:23 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-a9ca8155-f95a-4d1f-870a-cb08497059f7 tempest-VolumeDependencyTests-41616770 None] Deleted volume successfully. Apr 28 06:01:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a9ca8155-f95a-4d1f-870a-cb08497059f7 tempest-VolumeDependencyTests-41616770 None] Lock "cinder-3f57a65b-9b19-4157-8f57-986827a37b96-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:23 devstack sudo[91594]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-879e2c5c-b594-4634-8907-6832b99c5e66 tempest-CinderUnicodeTest-52966463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.587da008-7be3-4328-94be-cc931ada1cb0" returned: 0 in 0.508s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-879e2c5c-b594-4634-8907-6832b99c5e66 tempest-CinderUnicodeTest-52966463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:23 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.info Apr 28 06:01:23 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:23 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:23 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-dd776aa4-0003-4b65-8a2d-8f086f171bb8 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.524s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:23 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-dd776aa4-0003-4b65-8a2d-8f086f171bb8 tempest-CreateVolumesFromSnapshotTest-841124067 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:01:23 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-dd776aa4-0003-4b65-8a2d-8f086f171bb8 tempest-CreateVolumesFromSnapshotTest-841124067 None] Deleted volume successfully. Apr 28 06:01:23 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-dd776aa4-0003-4b65-8a2d-8f086f171bb8 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-1f3da6b0-f84c-4432-9c86-ae1b40c7d12e-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:24 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-879e2c5c-b594-4634-8907-6832b99c5e66 tempest-CinderUnicodeTest-52966463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.info" returned: 0 in 0.523s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:24 devstack cinder-volume[81829]: WARNING cinder.volume.drivers.remotefs [None req-879e2c5c-b594-4634-8907-6832b99c5e66 tempest-CinderUnicodeTest-52966463 None] /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.info is being set with open permissions: ugo+rw Apr 28 06:01:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-879e2c5c-b594-4634-8907-6832b99c5e66 tempest-CinderUnicodeTest-52966463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.info {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:24 devstack sudo[91626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.info Apr 28 06:01:24 devstack sudo[91626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:24 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-193b3ed0-91d3-484a-bee6-7a3f9393453f tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "cinder-66577cac-f95e-40d7-921c-dc1f370db874-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:24 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-193b3ed0-91d3-484a-bee6-7a3f9393453f tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-66577cac-f95e-40d7-921c-dc1f370db874-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:24 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-193b3ed0-91d3-484a-bee6-7a3f9393453f tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "cinder-quobyte-66577cac-f95e-40d7-921c-dc1f370db874" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:24 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-193b3ed0-91d3-484a-bee6-7a3f9393453f tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-quobyte-66577cac-f95e-40d7-921c-dc1f370db874" acquired by "delete_volume" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:24 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81e6281-7b25-4912-bf78-201b1cc41f8e]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-193b3ed0-91d3-484a-bee6-7a3f9393453f tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-66577cac-f95e-40d7-921c-dc1f370db874 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:24 devstack sudo[91628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-66577cac-f95e-40d7-921c-dc1f370db874 Apr 28 06:01:24 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:24 devstack sudo[91626]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-879e2c5c-b594-4634-8907-6832b99c5e66 tempest-CinderUnicodeTest-52966463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.info" returned: 0 in 0.524s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-879e2c5c-b594-4634-8907-6832b99c5e66 tempest-CinderUnicodeTest-52966463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.337s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:24 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-879e2c5c-b594-4634-8907-6832b99c5e66 tempest-CinderUnicodeTest-52966463 None] Create snapshot completed successfully Apr 28 06:01:24 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-193b3ed0-91d3-484a-bee6-7a3f9393453f tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-66577cac-f95e-40d7-921c-dc1f370db874" returned: 0 in 0.626s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:24 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-193b3ed0-91d3-484a-bee6-7a3f9393453f tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-66577cac-f95e-40d7-921c-dc1f370db874 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:24 devstack sudo[91634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-66577cac-f95e-40d7-921c-dc1f370db874 Apr 28 06:01:24 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:25 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-193b3ed0-91d3-484a-bee6-7a3f9393453f tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-66577cac-f95e-40d7-921c-dc1f370db874" returned: 0 in 0.472s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-193b3ed0-91d3-484a-bee6-7a3f9393453f tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-quobyte-66577cac-f95e-40d7-921c-dc1f370db874" released by "delete_volume" :: held 1.157s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:25 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-193b3ed0-91d3-484a-bee6-7a3f9393453f tempest-CreateVolumesFromSnapshotTest-841124067 None] Created reservations ['f0171382-f1a6-414c-99f6-bf5e974959e4', '8164b42c-6a3c-4832-8dad-ed32b778f2a8', 'b2cb2897-5952-4ba3-8bae-28b6c145de2d', '3c54698b-a899-4b58-a2ae-0b033e12581d'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:01:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-59cf802d-9ad0-4074-a887-4cf14f0809ab tempest-CinderUnicodeTest-52966463 None] Acquiring lock "cinder-587da008-7be3-4328-94be-cc931ada1cb0-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-59cf802d-9ad0-4074-a887-4cf14f0809ab tempest-CinderUnicodeTest-52966463 None] Lock "cinder-587da008-7be3-4328-94be-cc931ada1cb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-59cf802d-9ad0-4074-a887-4cf14f0809ab tempest-CinderUnicodeTest-52966463 None] Acquiring lock "cinder-quobyte-46494ea9-2a45-43a0-afc6-0d61b8b92552" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-59cf802d-9ad0-4074-a887-4cf14f0809ab tempest-CinderUnicodeTest-52966463 None] Lock "cinder-quobyte-46494ea9-2a45-43a0-afc6-0d61b8b92552" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-59cf802d-9ad0-4074-a887-4cf14f0809ab tempest-CinderUnicodeTest-52966463 None] Acquiring lock "cinder-quobyte-587da008-7be3-4328-94be-cc931ada1cb0" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:25 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-59cf802d-9ad0-4074-a887-4cf14f0809ab tempest-CinderUnicodeTest-52966463 None] Lock "cinder-quobyte-587da008-7be3-4328-94be-cc931ada1cb0" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-59cf802d-9ad0-4074-a887-4cf14f0809ab tempest-CinderUnicodeTest-52966463 None] Deleting offline snapshot 587da008-7be3-4328-94be-cc931ada1cb0 of volume 46494ea9-2a45-43a0-afc6-0d61b8b92552 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 06:01:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-59cf802d-9ad0-4074-a887-4cf14f0809ab tempest-CinderUnicodeTest-52966463 None] snapshot_file for this snap is: volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.587da008-7be3-4328-94be-cc931ada1cb0 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 06:01:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-193b3ed0-91d3-484a-bee6-7a3f9393453f tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:01:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-193b3ed0-91d3-484a-bee6-7a3f9393453f tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-193b3ed0-91d3-484a-bee6-7a3f9393453f tempest-CreateVolumesFromSnapshotTest-841124067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:01:25 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-193b3ed0-91d3-484a-bee6-7a3f9393453f tempest-CreateVolumesFromSnapshotTest-841124067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:01:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-193b3ed0-91d3-484a-bee6-7a3f9393453f tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-193b3ed0-91d3-484a-bee6-7a3f9393453f tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:25 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a79f9fa-0ecc-4325-9ccc-75ce14722213]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-59cf802d-9ad0-4074-a887-4cf14f0809ab tempest-CinderUnicodeTest-52966463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.587da008-7be3-4328-94be-cc931ada1cb0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:25 devstack sudo[91637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:01:25 devstack sudo[91637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:25 devstack sudo[91638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.587da008-7be3-4328-94be-cc931ada1cb0 Apr 28 06:01:25 devstack sudo[91638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:25 devstack sudo[91637]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:25 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-193b3ed0-91d3-484a-bee6-7a3f9393453f tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.429s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:25 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-193b3ed0-91d3-484a-bee6-7a3f9393453f tempest-CreateVolumesFromSnapshotTest-841124067 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:01:25 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-193b3ed0-91d3-484a-bee6-7a3f9393453f tempest-CreateVolumesFromSnapshotTest-841124067 None] Deleted volume successfully. Apr 28 06:01:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-193b3ed0-91d3-484a-bee6-7a3f9393453f tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-66577cac-f95e-40d7-921c-dc1f370db874-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:26 devstack sudo[91638]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-59cf802d-9ad0-4074-a887-4cf14f0809ab tempest-CinderUnicodeTest-52966463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.587da008-7be3-4328-94be-cc931ada1cb0" returned: 0 in 0.540s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:26 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-59cf802d-9ad0-4074-a887-4cf14f0809ab tempest-CinderUnicodeTest-52966463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46494ea9-2a45-43a0-afc6-0d61b8b92552(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 06:01:26 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[d508b88f-9dd6-4473-9dec-ed50f87ce22f]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-59cf802d-9ad0-4074-a887-4cf14f0809ab tempest-CinderUnicodeTest-52966463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:26 devstack sudo[91645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552 Apr 28 06:01:26 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b34bfe9e-af00-4f2b-b449-46bad6aafc06 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "cinder-1511b86d-4418-4fe7-b975-6f1370ee713c-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b34bfe9e-af00-4f2b-b449-46bad6aafc06 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-1511b86d-4418-4fe7-b975-6f1370ee713c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b34bfe9e-af00-4f2b-b449-46bad6aafc06 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "cinder-quobyte-1511b86d-4418-4fe7-b975-6f1370ee713c" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:26 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b34bfe9e-af00-4f2b-b449-46bad6aafc06 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-quobyte-1511b86d-4418-4fe7-b975-6f1370ee713c" acquired by "delete_volume" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:26 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7f662e-c47c-49bd-8039-5aaa4dc5c79e]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b34bfe9e-af00-4f2b-b449-46bad6aafc06 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1511b86d-4418-4fe7-b975-6f1370ee713c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:26 devstack sudo[91647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1511b86d-4418-4fe7-b975-6f1370ee713c Apr 28 06:01:26 devstack sudo[91647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:26 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-59cf802d-9ad0-4074-a887-4cf14f0809ab tempest-CinderUnicodeTest-52966463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552" returned: 0 in 0.563s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:26 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-59cf802d-9ad0-4074-a887-4cf14f0809ab tempest-CinderUnicodeTest-52966463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.587da008-7be3-4328-94be-cc931ada1cb0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:26 devstack sudo[91652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.587da008-7be3-4328-94be-cc931ada1cb0 Apr 28 06:01:26 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:27 devstack sudo[91647]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b34bfe9e-af00-4f2b-b449-46bad6aafc06 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1511b86d-4418-4fe7-b975-6f1370ee713c" returned: 0 in 0.528s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b34bfe9e-af00-4f2b-b449-46bad6aafc06 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1511b86d-4418-4fe7-b975-6f1370ee713c {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:27 devstack sudo[91657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1511b86d-4418-4fe7-b975-6f1370ee713c Apr 28 06:01:27 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:27 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-59cf802d-9ad0-4074-a887-4cf14f0809ab tempest-CinderUnicodeTest-52966463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.587da008-7be3-4328-94be-cc931ada1cb0" returned: 0 in 0.531s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-59cf802d-9ad0-4074-a887-4cf14f0809ab tempest-CinderUnicodeTest-52966463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.587da008-7be3-4328-94be-cc931ada1cb0 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:27 devstack sudo[91662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.587da008-7be3-4328-94be-cc931ada1cb0 Apr 28 06:01:27 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:27 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b34bfe9e-af00-4f2b-b449-46bad6aafc06 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-1511b86d-4418-4fe7-b975-6f1370ee713c" returned: 0 in 0.467s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b34bfe9e-af00-4f2b-b449-46bad6aafc06 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-quobyte-1511b86d-4418-4fe7-b975-6f1370ee713c" released by "delete_volume" :: held 1.057s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:27 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-b34bfe9e-af00-4f2b-b449-46bad6aafc06 tempest-CreateVolumesFromSnapshotTest-841124067 None] Created reservations ['b2f5ff16-28fd-435d-8041-46eb873ad1ef', '7a3e2254-3683-4c86-bd51-9e5fded6b945', '6fe035b9-548e-4503-8268-51b6129ddf24', '1e37af68-2ff5-4640-acdd-4106dc97f2a4'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:01:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b34bfe9e-af00-4f2b-b449-46bad6aafc06 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:01:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b34bfe9e-af00-4f2b-b449-46bad6aafc06 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:27 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b34bfe9e-af00-4f2b-b449-46bad6aafc06 tempest-CreateVolumesFromSnapshotTest-841124067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:01:27 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b34bfe9e-af00-4f2b-b449-46bad6aafc06 tempest-CreateVolumesFromSnapshotTest-841124067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:01:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b34bfe9e-af00-4f2b-b449-46bad6aafc06 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b34bfe9e-af00-4f2b-b449-46bad6aafc06 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:27 devstack sudo[91666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:01:27 devstack sudo[91666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:27 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:27 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-59cf802d-9ad0-4074-a887-4cf14f0809ab tempest-CinderUnicodeTest-52966463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552.587da008-7be3-4328-94be-cc931ada1cb0" returned: 0 in 0.474s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-59cf802d-9ad0-4074-a887-4cf14f0809ab tempest-CinderUnicodeTest-52966463 None] Lock "cinder-quobyte-587da008-7be3-4328-94be-cc931ada1cb0" released by "_delete_snapshot" :: held 2.231s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-59cf802d-9ad0-4074-a887-4cf14f0809ab tempest-CinderUnicodeTest-52966463 None] Lock "cinder-quobyte-46494ea9-2a45-43a0-afc6-0d61b8b92552" released by "delete_snapshot" :: held 2.265s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:27 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-59cf802d-9ad0-4074-a887-4cf14f0809ab tempest-CinderUnicodeTest-52966463 None] Created reservations ['d95ba157-3edd-40bb-88f9-0e562fa32e80', 'f4af4cd6-a82a-4919-b87e-73b147e56103', 'd5ea119b-8209-4993-a72b-cae4048fc090', '9de51534-d9e7-41e1-88e2-8dbc6688db84'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:01:27 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-59cf802d-9ad0-4074-a887-4cf14f0809ab tempest-CinderUnicodeTest-52966463 None] Delete snapshot completed successfully. Apr 28 06:01:27 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-59cf802d-9ad0-4074-a887-4cf14f0809ab tempest-CinderUnicodeTest-52966463 None] Lock "cinder-587da008-7be3-4328-94be-cc931ada1cb0-delete_snapshot" released by "delete_snapshot" :: held 2.401s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:28 devstack sudo[91666]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b34bfe9e-af00-4f2b-b449-46bad6aafc06 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.465s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:28 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-b34bfe9e-af00-4f2b-b449-46bad6aafc06 tempest-CreateVolumesFromSnapshotTest-841124067 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:01:28 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-b34bfe9e-af00-4f2b-b449-46bad6aafc06 tempest-CreateVolumesFromSnapshotTest-841124067 None] Deleted volume successfully. Apr 28 06:01:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b34bfe9e-af00-4f2b-b449-46bad6aafc06 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-1511b86d-4418-4fe7-b975-6f1370ee713c-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5d39e220-1953-4f35-92ee-f1a00651f432 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "cinder-dbc1ed3f-b454-4f88-95b2-1bc42d838481-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5d39e220-1953-4f35-92ee-f1a00651f432 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-dbc1ed3f-b454-4f88-95b2-1bc42d838481-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b22e6ef0-ab04-4e4b-84c8-ce69ce8b4716 tempest-CinderUnicodeTest-52966463 None] Acquiring lock "cinder-46494ea9-2a45-43a0-afc6-0d61b8b92552-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5d39e220-1953-4f35-92ee-f1a00651f432 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "cinder-quobyte-dbc1ed3f-b454-4f88-95b2-1bc42d838481" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b22e6ef0-ab04-4e4b-84c8-ce69ce8b4716 tempest-CinderUnicodeTest-52966463 None] Lock "cinder-46494ea9-2a45-43a0-afc6-0d61b8b92552-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5d39e220-1953-4f35-92ee-f1a00651f432 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-quobyte-dbc1ed3f-b454-4f88-95b2-1bc42d838481" acquired by "delete_volume" :: waited 0.029s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:28 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1990990-3f12-4780-a20f-ae894cb1d695]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5d39e220-1953-4f35-92ee-f1a00651f432 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbc1ed3f-b454-4f88-95b2-1bc42d838481 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b22e6ef0-ab04-4e4b-84c8-ce69ce8b4716 tempest-CinderUnicodeTest-52966463 None] Acquiring lock "cinder-quobyte-46494ea9-2a45-43a0-afc6-0d61b8b92552" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:28 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b22e6ef0-ab04-4e4b-84c8-ce69ce8b4716 tempest-CinderUnicodeTest-52966463 None] Lock "cinder-quobyte-46494ea9-2a45-43a0-afc6-0d61b8b92552" acquired by "delete_volume" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:28 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[087984c8-37b6-4b8c-b39d-e05d450a8447]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:28 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b22e6ef0-ab04-4e4b-84c8-ce69ce8b4716 tempest-CinderUnicodeTest-52966463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:28 devstack sudo[91669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbc1ed3f-b454-4f88-95b2-1bc42d838481 Apr 28 06:01:28 devstack sudo[91669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:28 devstack sudo[91670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552 Apr 28 06:01:28 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:29 devstack sudo[91669]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5d39e220-1953-4f35-92ee-f1a00651f432 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbc1ed3f-b454-4f88-95b2-1bc42d838481" returned: 0 in 0.531s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5d39e220-1953-4f35-92ee-f1a00651f432 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbc1ed3f-b454-4f88-95b2-1bc42d838481 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:29 devstack sudo[91679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbc1ed3f-b454-4f88-95b2-1bc42d838481 Apr 28 06:01:29 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:29 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b22e6ef0-ab04-4e4b-84c8-ce69ce8b4716 tempest-CinderUnicodeTest-52966463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552" returned: 0 in 0.526s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b22e6ef0-ab04-4e4b-84c8-ce69ce8b4716 tempest-CinderUnicodeTest-52966463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:29 devstack sudo[91681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552 Apr 28 06:01:29 devstack sudo[91681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:29 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5d39e220-1953-4f35-92ee-f1a00651f432 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-dbc1ed3f-b454-4f88-95b2-1bc42d838481" returned: 0 in 0.441s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:29 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5d39e220-1953-4f35-92ee-f1a00651f432 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-quobyte-dbc1ed3f-b454-4f88-95b2-1bc42d838481" released by "delete_volume" :: held 1.023s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:29 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-5d39e220-1953-4f35-92ee-f1a00651f432 tempest-CreateVolumesFromSnapshotTest-841124067 None] Created reservations ['fbb70eec-891b-4905-a799-79f6b3986dea', '804a5e43-6cce-4594-b331-3a9030091a3b', '52df9e0c-1aa4-4540-99d5-992aff22560b', 'f04098e2-1f8f-498d-8caa-541783334853'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:01:29 devstack sudo[91681]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b22e6ef0-ab04-4e4b-84c8-ce69ce8b4716 tempest-CinderUnicodeTest-52966463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-46494ea9-2a45-43a0-afc6-0d61b8b92552" returned: 0 in 0.478s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:29 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b22e6ef0-ab04-4e4b-84c8-ce69ce8b4716 tempest-CinderUnicodeTest-52966463 None] Lock "cinder-quobyte-46494ea9-2a45-43a0-afc6-0d61b8b92552" released by "delete_volume" :: held 1.061s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5d39e220-1953-4f35-92ee-f1a00651f432 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:01:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5d39e220-1953-4f35-92ee-f1a00651f432 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5d39e220-1953-4f35-92ee-f1a00651f432 tempest-CreateVolumesFromSnapshotTest-841124067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:01:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-5d39e220-1953-4f35-92ee-f1a00651f432 tempest-CreateVolumesFromSnapshotTest-841124067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:01:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-5d39e220-1953-4f35-92ee-f1a00651f432 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5d39e220-1953-4f35-92ee-f1a00651f432 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:29 devstack sudo[91685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:01:29 devstack sudo[91685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:29 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-b22e6ef0-ab04-4e4b-84c8-ce69ce8b4716 tempest-CinderUnicodeTest-52966463 None] Created reservations ['1d4a416c-f780-4e3c-9f84-71f8e734517f', 'efc80ca8-07c2-42b6-b769-ad6625737bb2', '3634bb85-b9bf-42da-bd6b-091596bdd9ca', '72e8e74e-06b5-4bee-b766-c338d0678122'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:01:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b22e6ef0-ab04-4e4b-84c8-ce69ce8b4716 tempest-CinderUnicodeTest-52966463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:01:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b22e6ef0-ab04-4e4b-84c8-ce69ce8b4716 tempest-CinderUnicodeTest-52966463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b22e6ef0-ab04-4e4b-84c8-ce69ce8b4716 tempest-CinderUnicodeTest-52966463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:01:29 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-b22e6ef0-ab04-4e4b-84c8-ce69ce8b4716 tempest-CinderUnicodeTest-52966463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:01:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-b22e6ef0-ab04-4e4b-84c8-ce69ce8b4716 tempest-CinderUnicodeTest-52966463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:29 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b22e6ef0-ab04-4e4b-84c8-ce69ce8b4716 tempest-CinderUnicodeTest-52966463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:29 devstack sudo[91687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:01:29 devstack sudo[91687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:30 devstack sudo[91685]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-5d39e220-1953-4f35-92ee-f1a00651f432 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.445s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:30 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-5d39e220-1953-4f35-92ee-f1a00651f432 tempest-CreateVolumesFromSnapshotTest-841124067 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:01:30 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-5d39e220-1953-4f35-92ee-f1a00651f432 tempest-CreateVolumesFromSnapshotTest-841124067 None] Deleted volume successfully. Apr 28 06:01:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-5d39e220-1953-4f35-92ee-f1a00651f432 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-dbc1ed3f-b454-4f88-95b2-1bc42d838481-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:30 devstack sudo[91687]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-b22e6ef0-ab04-4e4b-84c8-ce69ce8b4716 tempest-CinderUnicodeTest-52966463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.453s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:30 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-b22e6ef0-ab04-4e4b-84c8-ce69ce8b4716 tempest-CinderUnicodeTest-52966463 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:01:30 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-b22e6ef0-ab04-4e4b-84c8-ce69ce8b4716 tempest-CinderUnicodeTest-52966463 None] Deleted volume successfully. Apr 28 06:01:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-b22e6ef0-ab04-4e4b-84c8-ce69ce8b4716 tempest-CinderUnicodeTest-52966463 None] Lock "cinder-46494ea9-2a45-43a0-afc6-0d61b8b92552-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6649fab2-fa99-45bf-b1a4-cd609d70e771 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "cinder-68a8eb3a-09ba-4b7f-877c-c6f82fb38410-delete_snapshot" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6649fab2-fa99-45bf-b1a4-cd609d70e771 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-68a8eb3a-09ba-4b7f-877c-c6f82fb38410-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6649fab2-fa99-45bf-b1a4-cd609d70e771 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "cinder-quobyte-47dd9929-8c40-427d-a9ec-baa763df3902" by "delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6649fab2-fa99-45bf-b1a4-cd609d70e771 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-quobyte-47dd9929-8c40-427d-a9ec-baa763df3902" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6649fab2-fa99-45bf-b1a4-cd609d70e771 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "cinder-quobyte-68a8eb3a-09ba-4b7f-877c-c6f82fb38410" by "_delete_snapshot" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6649fab2-fa99-45bf-b1a4-cd609d70e771 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-quobyte-68a8eb3a-09ba-4b7f-877c-c6f82fb38410" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-6649fab2-fa99-45bf-b1a4-cd609d70e771 tempest-CreateVolumesFromSnapshotTest-841124067 None] Deleting offline snapshot 68a8eb3a-09ba-4b7f-877c-c6f82fb38410 of volume 47dd9929-8c40-427d-a9ec-baa763df3902 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 28 06:01:30 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-6649fab2-fa99-45bf-b1a4-cd609d70e771 tempest-CreateVolumesFromSnapshotTest-841124067 None] snapshot_file for this snap is: volume-47dd9929-8c40-427d-a9ec-baa763df3902.68a8eb3a-09ba-4b7f-877c-c6f82fb38410 {{(pid=81829) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 28 06:01:30 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f56ea6e-e463-4926-9c40-acb4ca2ebd7d]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:30 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6649fab2-fa99-45bf-b1a4-cd609d70e771 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.68a8eb3a-09ba-4b7f-877c-c6f82fb38410 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a45537eb-cd95-4440-882b-08fa6f6fa94c tempest-CinderUnicodeTest-52966463 None] Acquiring lock "cinder-f9f4a981-2bd6-49d6-82e0-e154a150dace-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a45537eb-cd95-4440-882b-08fa6f6fa94c tempest-CinderUnicodeTest-52966463 None] Lock "cinder-f9f4a981-2bd6-49d6-82e0-e154a150dace-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a45537eb-cd95-4440-882b-08fa6f6fa94c tempest-CinderUnicodeTest-52966463 None] Acquiring lock "cinder-quobyte-f9f4a981-2bd6-49d6-82e0-e154a150dace" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:30 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.68a8eb3a-09ba-4b7f-877c-c6f82fb38410 Apr 28 06:01:30 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:30 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a45537eb-cd95-4440-882b-08fa6f6fa94c tempest-CinderUnicodeTest-52966463 None] Lock "cinder-quobyte-f9f4a981-2bd6-49d6-82e0-e154a150dace" acquired by "delete_volume" :: waited 0.018s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:31 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8fd5c6-1f60-4cab-ae13-f1949e66d60e]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a45537eb-cd95-4440-882b-08fa6f6fa94c tempest-CinderUnicodeTest-52966463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f9f4a981-2bd6-49d6-82e0-e154a150dace {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:31 devstack sudo[91693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f9f4a981-2bd6-49d6-82e0-e154a150dace Apr 28 06:01:31 devstack sudo[91693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:31 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6649fab2-fa99-45bf-b1a4-cd609d70e771 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.68a8eb3a-09ba-4b7f-877c-c6f82fb38410" returned: 0 in 0.521s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:31 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.remotefs [None req-6649fab2-fa99-45bf-b1a4-cd609d70e771 tempest-CreateVolumesFromSnapshotTest-841124067 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47dd9929-8c40-427d-a9ec-baa763df3902(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81829) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 28 06:01:31 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ef1da4-abcb-4859-b47a-8ec54cbb1315]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6649fab2-fa99-45bf-b1a4-cd609d70e771 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:31 devstack sudo[91701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902 Apr 28 06:01:31 devstack sudo[91701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:31 devstack sudo[91693]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a45537eb-cd95-4440-882b-08fa6f6fa94c tempest-CinderUnicodeTest-52966463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f9f4a981-2bd6-49d6-82e0-e154a150dace" returned: 0 in 0.548s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a45537eb-cd95-4440-882b-08fa6f6fa94c tempest-CinderUnicodeTest-52966463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f9f4a981-2bd6-49d6-82e0-e154a150dace {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:31 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f9f4a981-2bd6-49d6-82e0-e154a150dace Apr 28 06:01:31 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:31 devstack sudo[91701]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6649fab2-fa99-45bf-b1a4-cd609d70e771 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902" returned: 0 in 0.538s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:31 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6649fab2-fa99-45bf-b1a4-cd609d70e771 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.68a8eb3a-09ba-4b7f-877c-c6f82fb38410 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:32 devstack sudo[91710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.68a8eb3a-09ba-4b7f-877c-c6f82fb38410 Apr 28 06:01:32 devstack sudo[91710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:32 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a45537eb-cd95-4440-882b-08fa6f6fa94c tempest-CinderUnicodeTest-52966463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-f9f4a981-2bd6-49d6-82e0-e154a150dace" returned: 0 in 0.460s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:32 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a45537eb-cd95-4440-882b-08fa6f6fa94c tempest-CinderUnicodeTest-52966463 None] Lock "cinder-quobyte-f9f4a981-2bd6-49d6-82e0-e154a150dace" released by "delete_volume" :: held 1.046s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:32 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-a45537eb-cd95-4440-882b-08fa6f6fa94c tempest-CinderUnicodeTest-52966463 None] Created reservations ['6333caad-2df1-4991-a1fc-b0e6e34eb985', '45e6d169-e3b2-45b2-96f8-be569db51bf5', '78565a12-47ff-43a4-9eac-62b3b8b00e6c', '07a42398-6885-4d53-915d-aa39670f9d97'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:01:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a45537eb-cd95-4440-882b-08fa6f6fa94c tempest-CinderUnicodeTest-52966463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:01:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a45537eb-cd95-4440-882b-08fa6f6fa94c tempest-CinderUnicodeTest-52966463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:32 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a45537eb-cd95-4440-882b-08fa6f6fa94c tempest-CinderUnicodeTest-52966463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:01:32 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-a45537eb-cd95-4440-882b-08fa6f6fa94c tempest-CinderUnicodeTest-52966463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:01:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-a45537eb-cd95-4440-882b-08fa6f6fa94c tempest-CinderUnicodeTest-52966463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a45537eb-cd95-4440-882b-08fa6f6fa94c tempest-CinderUnicodeTest-52966463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:32 devstack sudo[91712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:01:32 devstack sudo[91712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:32 devstack sudo[91710]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6649fab2-fa99-45bf-b1a4-cd609d70e771 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.68a8eb3a-09ba-4b7f-877c-c6f82fb38410" returned: 0 in 0.547s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6649fab2-fa99-45bf-b1a4-cd609d70e771 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.68a8eb3a-09ba-4b7f-877c-c6f82fb38410 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:32 devstack sudo[91718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.68a8eb3a-09ba-4b7f-877c-c6f82fb38410 Apr 28 06:01:32 devstack sudo[91718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:32 devstack sudo[91712]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-a45537eb-cd95-4440-882b-08fa6f6fa94c tempest-CinderUnicodeTest-52966463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.458s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:32 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-a45537eb-cd95-4440-882b-08fa6f6fa94c tempest-CinderUnicodeTest-52966463 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:01:32 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-a45537eb-cd95-4440-882b-08fa6f6fa94c tempest-CinderUnicodeTest-52966463 None] Deleted volume successfully. Apr 28 06:01:32 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-a45537eb-cd95-4440-882b-08fa6f6fa94c tempest-CinderUnicodeTest-52966463 None] Lock "cinder-f9f4a981-2bd6-49d6-82e0-e154a150dace-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:32 devstack sudo[91718]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:32 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-6649fab2-fa99-45bf-b1a4-cd609d70e771 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902.68a8eb3a-09ba-4b7f-877c-c6f82fb38410" returned: 0 in 0.447s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:33 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6649fab2-fa99-45bf-b1a4-cd609d70e771 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-quobyte-68a8eb3a-09ba-4b7f-877c-c6f82fb38410" released by "_delete_snapshot" :: held 2.153s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:33 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6649fab2-fa99-45bf-b1a4-cd609d70e771 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-quobyte-47dd9929-8c40-427d-a9ec-baa763df3902" released by "delete_snapshot" :: held 2.176s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:33 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-6649fab2-fa99-45bf-b1a4-cd609d70e771 tempest-CreateVolumesFromSnapshotTest-841124067 None] Created reservations ['b357a37f-1163-4fff-84cb-bc0e46206cdb', '1dcb2c68-220a-4c41-83e5-b23ce4612f4b', '8b83062b-e824-45c7-b6b9-5b686f199152', 'a763656f-4b49-43d1-8f6e-378c0bd5ba32'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:01:33 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-6649fab2-fa99-45bf-b1a4-cd609d70e771 tempest-CreateVolumesFromSnapshotTest-841124067 None] Delete snapshot completed successfully. Apr 28 06:01:33 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-6649fab2-fa99-45bf-b1a4-cd609d70e771 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-68a8eb3a-09ba-4b7f-877c-c6f82fb38410-delete_snapshot" released by "delete_snapshot" :: held 2.313s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2a696266-b9c4-4fe6-8ac2-12d028ba7127 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "cinder-47dd9929-8c40-427d-a9ec-baa763df3902-delete_volume" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2a696266-b9c4-4fe6-8ac2-12d028ba7127 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-47dd9929-8c40-427d-a9ec-baa763df3902-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2a696266-b9c4-4fe6-8ac2-12d028ba7127 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "cinder-quobyte-47dd9929-8c40-427d-a9ec-baa763df3902" by "delete_volume" {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 28 06:01:34 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2a696266-b9c4-4fe6-8ac2-12d028ba7127 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-quobyte-47dd9929-8c40-427d-a9ec-baa763df3902" acquired by "delete_volume" :: waited 0.025s {{(pid=81829) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 28 06:01:34 devstack cinder-volume[81829]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c06884-5889-437d-8270-c433665ca363]: (4, 'qcow2') {{(pid=82697) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 28 06:01:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2a696266-b9c4-4fe6-8ac2-12d028ba7127 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:34 devstack sudo[91721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902 Apr 28 06:01:34 devstack sudo[91721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:34 devstack sudo[91721]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2a696266-b9c4-4fe6-8ac2-12d028ba7127 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902" returned: 0 in 0.556s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:34 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2a696266-b9c4-4fe6-8ac2-12d028ba7127 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:34 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902 Apr 28 06:01:34 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:35 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2a696266-b9c4-4fe6-8ac2-12d028ba7127 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574/volume-47dd9929-8c40-427d-a9ec-baa763df3902" returned: 0 in 0.424s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:35 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2a696266-b9c4-4fe6-8ac2-12d028ba7127 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-quobyte-47dd9929-8c40-427d-a9ec-baa763df3902" released by "delete_volume" :: held 1.056s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:35 devstack cinder-volume[81829]: DEBUG cinder.quota [None req-2a696266-b9c4-4fe6-8ac2-12d028ba7127 tempest-CreateVolumesFromSnapshotTest-841124067 None] Created reservations ['1c78e88c-0f99-4e36-be89-d669650a5b90', '21b0da6f-9df6-4a49-849d-24443af152c6', 'af78019e-22e9-4239-9cd2-f06cf139cca7', '09430176-65d0-4c2d-bd6e-abcbfb94a9a8'] {{(pid=81829) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 28 06:01:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-2a696266-b9c4-4fe6-8ac2-12d028ba7127 tempest-CreateVolumesFromSnapshotTest-841124067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 28 06:01:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-2a696266-b9c4-4fe6-8ac2-12d028ba7127 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 28 06:01:35 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-2a696266-b9c4-4fe6-8ac2-12d028ba7127 tempest-CreateVolumesFromSnapshotTest-841124067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381': None} {{(pid=81829) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 28 06:01:35 devstack cinder-volume[81829]: DEBUG cinder.volume.drivers.quobyte [None req-2a696266-b9c4-4fe6-8ac2-12d028ba7127 tempest-CreateVolumesFromSnapshotTest-841124067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4ccf4965-22c5-4881-b782-9fe090c96381'] {{(pid=81829) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 28 06:01:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.lockutils [None req-2a696266-b9c4-4fe6-8ac2-12d028ba7127 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81829) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 28 06:01:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2a696266-b9c4-4fe6-8ac2-12d028ba7127 tempest-CreateVolumesFromSnapshotTest-841124067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 28 06:01:35 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574 Apr 28 06:01:35 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 28 06:01:35 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Apr 28 06:01:35 devstack cinder-volume[81829]: DEBUG oslo_concurrency.processutils [None req-2a696266-b9c4-4fe6-8ac2-12d028ba7127 tempest-CreateVolumesFromSnapshotTest-841124067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/82856e16f72d4a81a6560c63b0be3574" returned: 0 in 0.434s {{(pid=81829) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 28 06:01:35 devstack cinder-volume[81829]: DEBUG cinder.manager [None req-2a696266-b9c4-4fe6-8ac2-12d028ba7127 tempest-CreateVolumesFromSnapshotTest-841124067 None] Notifying Schedulers of capabilities ... {{(pid=81829) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 28 06:01:35 devstack cinder-volume[81829]: INFO cinder.volume.manager [None req-2a696266-b9c4-4fe6-8ac2-12d028ba7127 tempest-CreateVolumesFromSnapshotTest-841124067 None] Deleted volume successfully. Apr 28 06:01:35 devstack cinder-volume[81829]: DEBUG cinder.coordination [None req-2a696266-b9c4-4fe6-8ac2-12d028ba7127 tempest-CreateVolumesFromSnapshotTest-841124067 None] Lock "cinder-47dd9929-8c40-427d-a9ec-baa763df3902-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=81829) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 28 06:01:45 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:UPDATE=116,cinder:DELETE=9,cinder:SELECT=71,cinder:INSERT=34 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 28 06:01:45 devstack cinder-volume[81829]: DEBUG dbcounter [-] [81829] Writing DB stats cinder:SELECT=127,cinder:INSERT=41,cinder:UPDATE=171,cinder:DELETE=13 {{(pid=81829) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}